Jul 09 02:38:42 devstack cinder-volume[75989]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 02:38:42 devstack cinder-volume[75989]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:38:42 devstack cinder-volume[75989]: we strongly recommend against using it for new projects. Jul 09 02:38:42 devstack cinder-volume[75989]: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:38:42 devstack cinder-volume[75989]: framework. For more detail see Jul 09 02:38:42 devstack cinder-volume[75989]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:38:42 devstack cinder-volume[75989]: import eventlet # noqa Jul 09 02:38:45 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:38:45 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:38:45 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:38:46 devstack cinder-volume[75989]: INFO dbcounter [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Registered counter for database cinder Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writer thread running {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:38:46 devstack cinder-volume[75989]: INFO cinder.rpc [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 02:38:46 devstack cinder-volume[75989]: INFO cinder.rpc [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:38:46 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Determined volume DB was empty at startup. Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75989) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 02:38:46 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 02:38:46 devstack cinder-volume[75989]: WARNING stevedore.named [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:38:46 devstack cinder-volume[75989]: WARNING castellan.key_manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:38:46 devstack cinder-volume[75989]: WARNING cinder.keymgr.conf_key_mgr [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75989) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 02:38:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] CMD "cinder-rtstool verify" returned: 0 in 0.479s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:38:47 devstack cinder-volume[75989]: INFO cinder.rpc [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 02:38:47 devstack cinder-volume[75989]: INFO cinder.rpc [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 02:38:47 devstack cinder-volume[75989]: WARNING stevedore.named [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:38:47 devstack cinder-volume[75989]: WARNING castellan.key_manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:38:47 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:38:47 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Starting 1 workers Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Started child 76157 {{(pid=75989) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Full set of CONF: {{(pid=75989) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] ******************************************************************************** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Configuration options gathered from: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] ================================================================================ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] allow_availability_zone_fallback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] allow_compression_on_image_upload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] allowed_direct_url_schemes = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] api_rate_limit = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] auth_strategy = keystone {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] az_cache_duration = 3600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_host = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_stats_polling_interval = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backup_api_class = cinder.backup.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backup_name_template = backup-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backup_use_same_host = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backup_use_temp_snapshot = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] chap_username = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_internal_tenant_project_id = eef95da6c7084a768fcb794df02ad962 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_internal_tenant_user_id = 595e61fe1778422db9e376a3c28f6f53 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cloned_volume_same_az = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cluster = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] compression_format = gzip {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] compute_api_class = cinder.compute.nova.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] config_dir = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] config_source = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] control_exchange = openstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] debug = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] default_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] default_group_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] default_volume_type = lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_ssl_cert_verify = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] driver_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] enable_force_upload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] enable_new_services = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] enable_unsupported_driver = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] enforce_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_api_insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_api_ssl_compression = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_ca_certificates_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_catalog_info = image:glance:publicURL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_num_retries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance_request_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] graceful_shutdown_timeout = 5 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] group_api_class = cinder.group.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] host = devstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_compress_on_upload = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_conversion_address_space_limit = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_conversion_cpu_limit = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_conversion_disable = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_upload_use_cinder_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_upload_use_internal_tenant = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_volume_cache_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_volume_cache_max_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] image_volume_cache_max_size_gb = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] init_host_max_objects_retrieval = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] instance_format = [instance: %(uuid)s] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iscsi_target_flags = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iscsi_write_cache = on {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iser_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iser_ip_address = 192.168.122.6 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iser_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_color = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_config_append = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_options = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_rotate_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_rotate_interval_type = days {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] log_rotation_type = none {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] max_age = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] max_logfile_count = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] max_logfile_size_mb = 200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] max_over_subscription_ratio = 20.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] message_reap_interval = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] message_ttl = 2592000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] migration_create_volume_timeout_secs = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] monkey_patch = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] monkey_patch_modules = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] my_ip = 192.168.122.6 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] no_snapshot_gb_quota = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] num_iser_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] num_shell_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] num_volume_device_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] nvmeof_conn_info_version = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] nvmet_ns_id = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] nvmet_port_id = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_max_limit = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_ext_list = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_listen_port = 8776 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] osapi_volume_workers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] per_volume_size_limit = -1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] periodic_fuzzy_delay = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] periodic_interval = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] public_endpoint = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] publish_errors = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_backup_gigabytes = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_backups = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_gigabytes = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_groups = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_snapshots = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] quota_volumes = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] rate_limit_burst = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] rate_limit_except_level = CRITICAL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] rate_limit_interval = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] reinit_driver_count = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] report_discard_supported = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] report_interval = 120 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] reservation_clean_interval = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] reservation_expire = 86400 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] reserved_image_namespaces = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] reserved_percentage = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] rpc_response_timeout = 120 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] run_external_periodic_tasks = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] scst_target_driver = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_down_time = 720 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] shell_completion = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] snapshot_name_template = snapshot-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] snapshot_same_host = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] state_path = /opt/stack/data/cinder {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] storage_availability_zone = nova {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] storage_protocol = iSCSI {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] syslog_log_facility = LOG_USER {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_helper = lioadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_ip_address = 192.168.122.6 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] target_secondary_ip_addresses = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] transport_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] until_refresh = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_chap_auth = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_default_quota_class = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_journal = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_json = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_stderr = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] use_syslog = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] verify_glance_signatures = enabled {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_api_class = cinder.volume.api.API {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_clear_size = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_copy_bps_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_dd_blocksize = 1M {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_name_template = volume-%s {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_service_inithost_offload = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volume_usage_audit_period = month {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] zoning_mode = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_concurrency.disable_process_locking = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.auth_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.cache = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.include_service_catalog = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.interface = public {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_password = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcache_username = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.service_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.backend = dogpile.cache.null {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.backend_argument = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.backend_expiration_time = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.config_prefix = cache.oslo {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.debug_cache_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.enable_retry_client = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.enable_socket_keepalive = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack sudo[76161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 02:38:47 devstack sudo[76161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.expiration_time = 600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.hashclient_retry_attempts = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_dead_retry = 300 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_pool_maxsize = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_sasl_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.proxies = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.redis_db = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.redis_server = localhost:6379 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.retry_attempts = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.retry_delay = 0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.socket_keepalive_count = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.socket_keepalive_idle = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.socket_keepalive_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.socket_timeout = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.tls_allowed_ciphers = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.tls_cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.tls_certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.tls_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.tls_keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cache.username = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] coordination.backend_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.asyncio_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.asyncio_slave_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.backend = sqlalchemy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.connection_debug = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.connection_parameters = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.connection_recycle_time = 3600 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.connection_trace = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.db_inc_retry_interval = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.db_max_retries = 20 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.db_max_retry_interval = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.db_retry_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.max_overflow = 50 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.max_pool_size = 5 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.max_retries = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.mysql_wsrep_sync_wait = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.pool_timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.retry_interval = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.slave_connection = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.sqlite_synchronous = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.synchronous_reader = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] database.use_db_reconnect = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.connection_string = messaging:// {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.es_doc_type = notification {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.es_scroll_size = 10000 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.es_scroll_time = 2m {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.filter_error_trace = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.hmac_keys = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.sentinel_service_name = mymaster {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.socket_timeout = 0.1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.trace_requests = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler.trace_sqlalchemy = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler_jaeger.process_tags = {} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler_jaeger.service_name_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] profiler_otlp.service_name_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.enforce_new_defaults = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.enforce_scope = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.policy_default_rule = default {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.policy_file = policy.yaml {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.group = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.helper_command = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] privsep_osbrick.user = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.group = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.helper_command = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] cinder_sys_admin.user = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.send_service_user_token = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] service_user.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.auth_type = password {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] glance.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.chap_username = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.driver_use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.extra_capabilities = {} {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iscsi_target_flags = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iscsi_write_cache = on {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iser_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iser_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.lvm_share_target = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.lvm_type = auto {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.num_shell_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.report_discard_supported = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.reserved_percentage = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_helper = tgtadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.unique_fqdn_network = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.use_chap_auth = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_backend_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_clear_size = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_reports.file_event_handler = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_reports.log_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.backend_host = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.chap_password = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.chap_username = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.disk_geometry = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_client_cert = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.extra_capabilities = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.filter_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.goodness_function = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iser_helper = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iser_ip_address = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iser_port = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.lvm_share_target = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.lvm_type = auto {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.num_shell_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.replication_device = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.report_discard_supported = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.reserved_percentage = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.scst_target_driver = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.storage_protocol = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_helper = lioadm {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_ip_address = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_port = 3260 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.trace_flags = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.use_chap_auth = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_clear = zero {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_clear_size = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] lvmdriver-1.volumes_dir = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_notifications.driver = [] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_notifications.retry = -1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] key_manager.fixed_key = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.barbican_api_version = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.barbican_endpoint = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.barbican_endpoint_type = public {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.barbican_region_name = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.number_of_retries = 60 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.retry_delay = 1 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.send_service_user_token = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.verify_ssl = True {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican.verify_ssl_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.auth_section = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.auth_type = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.cafile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.certfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.collect_timing = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.insecure = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.keyfile = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.split_loggers = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] barbican_service_user.timeout = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.approle_role_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.approle_secret_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.kv_mountpoint = secret {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.kv_path = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.kv_version = 2 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.namespace = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.root_token_id = **** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.ssl_ca_crt_file = None {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.timeout = 60.0 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.use_ssl = False {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:38:47 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] ******************************************************************************** {{(pid=75989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 02:38:48 devstack sudo[76161]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:48 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:48 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:48 devstack sudo[76286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:48 devstack sudo[76286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:49 devstack sudo[76286]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.660s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:38:49 devstack cinder-volume[76157]: INFO cinder.brick.local_dev.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:49 devstack sudo[76557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:38:49 devstack sudo[76557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:49 devstack sudo[76557]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG cinder.brick.local_dev.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76157) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 02:38:49 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:49 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:49 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:50 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:50 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.968s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:50 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:50 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:50 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:50 devstack sudo[76930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:50 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:51 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:51 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:51 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:51 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:51 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:51 devstack sudo[76938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 02:38:51 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:52 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:52 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.665s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:52 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:52 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:38:52 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:52 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:52 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:52 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:52 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:38:52 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:53 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:53 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.854s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:53 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:53 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:38:53 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:54 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:54 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.890s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:54 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:54 devstack sudo[76964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:54 devstack sudo[76964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:55 devstack sudo[76964]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:55 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:55 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:55 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:55 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:55 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:55 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:56 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:56 devstack cinder-volume[76157]: INFO cinder.volume.drivers.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:56 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:56 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:56 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:38:56 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:56 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:38:56 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:57 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:57 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:57 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:57 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:38:57 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:57 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:38:58 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:58 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:58 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:58 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:38:58 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:58 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:58 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.689s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:58 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:58 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:38:58 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:38:59 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:38:59 devstack cinder-volume[76157]: INFO cinder.volume.driver [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG cinder.volume.driver [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76157) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG oslo_db.sqlalchemy.engines [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76157) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writer thread running {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG cinder.db.api [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Building query based on filter {{(pid=76157) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG cinder.image.image_utils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76157) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 02:38:59 devstack cinder-volume[76157]: INFO cinder.keymgr.migration [None req-a16deb87-f133-4b39-b048-9fa4c74b791d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:38:59 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:38:59 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:38:59 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:00 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:00 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:00 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:00 devstack sudo[77257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:39:00 devstack sudo[77257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:00 devstack sudo[77257]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:00 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:00 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:00 devstack sudo[77263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:39:00 devstack sudo[77263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:01 devstack sudo[77263]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:01 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:01 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:01 devstack sudo[77267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:39:01 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:02 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:39:02 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Driver initialization completed successfully. Jul 09 02:39:02 devstack cinder-volume[76157]: INFO cinder.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Initiating service 2 cleanup Jul 09 02:39:02 devstack cinder-volume[76157]: INFO cinder.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Service 2 cleanup completed. Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG cinder.service [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Creating RPC server for service cinder-volume {{(pid=76157) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG cinder.service [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76157) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 02:39:02 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:39:02 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:02 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:39:02 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:03 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:03 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:03 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:03 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:39:03 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:03 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:03 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:03 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:03 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:39:03 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:04 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:04 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:04 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:39:04 devstack sudo[77337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:39:04 devstack sudo[77337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:39:05 devstack sudo[77337]: pam_unix(sudo:session): session closed for user root Jul 09 02:39:05 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:39:05 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-f953267a-735e-4ac3-a460-c1675fc16473 None None] Driver post RPC initialization completed successfully. Jul 09 02:39:12 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:39:12 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:39:12 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread info: [<_MainThread(MainThread, started 130076262146176)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:39:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:39:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:40:12 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:40:12 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:40:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:40:12 devstack sudo[79372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:40:12 devstack sudo[79372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:40:12 devstack sudo[79372]: pam_unix(sudo:session): session closed for user root Jul 09 02:40:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:40:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:40:12 devstack sudo[79378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:40:12 devstack sudo[79378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:40:13 devstack sudo[79378]: pam_unix(sudo:session): session closed for user root Jul 09 02:40:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:40:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:40:13 devstack sudo[79381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:40:13 devstack sudo[79381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:40:13 devstack sudo[79381]: pam_unix(sudo:session): session closed for user root Jul 09 02:40:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:40:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:40:13 devstack sudo[79384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:40:13 devstack sudo[79384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:40:14 devstack sudo[79384]: pam_unix(sudo:session): session closed for user root Jul 09 02:40:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:40:14 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:40:14 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:40:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:40:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread info: [<_MainThread(MainThread, started 130076262146176)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:41:12 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:41:12 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:41:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:41:12 devstack sudo[82581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:41:12 devstack sudo[82581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:41:12 devstack sudo[82581]: pam_unix(sudo:session): session closed for user root Jul 09 02:41:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:41:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:41:12 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:41:12 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:41:13 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Jul 09 02:41:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:41:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:41:13 devstack sudo[82604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:41:13 devstack sudo[82604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:41:13 devstack sudo[82604]: pam_unix(sudo:session): session closed for user root Jul 09 02:41:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:41:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:41:13 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:41:13 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:41:14 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Jul 09 02:41:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:41:14 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:41:14 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:41:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:41:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread info: [<_MainThread(MainThread, started 130076262146176)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:41:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:41:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:42:12 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:42:12 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:42:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:42:12 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:42:12 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:42:12 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Jul 09 02:42:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.785s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:42:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:42:12 devstack sudo[84642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:42:12 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:42:13 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root Jul 09 02:42:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:42:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:42:13 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:42:13 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:42:14 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:42:14 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:42:14 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:42:14 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:42:14 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] thread info: [<_MainThread(MainThread, started 130076262146176)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:43:12 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:43:12 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 02:43:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:12 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 02:43:12 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:12 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:12 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:12 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:43:12 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:13 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:13 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:13 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 02:43:13 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:14 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:14 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 02:43:14 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:14 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:14 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-16663309-0f3e-4dd4-ae9a-e9f40a03ee6c None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:43:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:43:15 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:43:22 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Caught SIGTERM, stopping children Jul 09 02:43:22 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:22 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:22 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:22 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Stop services. {{(pid=75989) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 02:43:22 devstack cinder-volume[75989]: DEBUG oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Killing children. {{(pid=75989) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 02:43:22 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Waiting on 1 children to exit Jul 09 02:43:22 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Acquiring lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:22 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Acquired lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:22 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Releasing lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:22 devstack cinder-volume[76157]: WARNING amqp [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 02:43:22 devstack cinder-volume[76157]: WARNING amqp [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 02:43:22 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [None req-95028b92-b8e9-491f-9ed5-d1409970b140 None None] Child 76157 exited with status 0 Jul 09 02:43:22 devstack cinder-volume[86281]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 02:43:22 devstack cinder-volume[86281]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:43:22 devstack cinder-volume[86281]: we strongly recommend against using it for new projects. Jul 09 02:43:22 devstack cinder-volume[86281]: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:43:22 devstack cinder-volume[86281]: framework. For more detail see Jul 09 02:43:22 devstack cinder-volume[86281]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:43:22 devstack cinder-volume[86281]: import eventlet # noqa Jul 09 02:43:24 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:24 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:24 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:25 devstack cinder-volume[86281]: INFO dbcounter [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Registered counter for database cinder Jul 09 02:43:25 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG dbcounter [-] [86281] Writer thread running {{(pid=86281) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:43:26 devstack cinder-volume[86281]: INFO cinder.rpc [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 02:43:26 devstack cinder-volume[86281]: INFO cinder.rpc [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:26 devstack cinder-volume[86281]: INFO cinder.volume.manager [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Determined volume DB was empty at startup. Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG cinder.volume.manager [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86281) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 02:43:26 devstack cinder-volume[86281]: INFO cinder.volume.manager [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 02:43:26 devstack cinder-volume[86281]: WARNING stevedore.named [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:43:26 devstack cinder-volume[86281]: WARNING castellan.key_manager [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:43:26 devstack cinder-volume[86281]: WARNING cinder.keymgr.conf_key_mgr [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:43:26 devstack cinder-volume[86281]: INFO cinder.volume.manager [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:26 devstack cinder-volume[86281]: INFO oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Starting 1 workers Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Started child 86495 {{(pid=86281) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Full set of CONF: {{(pid=86281) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] ******************************************************************************** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Configuration options gathered from: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] ================================================================================ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] allow_availability_zone_fallback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] allow_compression_on_image_upload = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] allowed_direct_url_schemes = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] api_rate_limit = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] auth_strategy = keystone {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_stats_polling_interval = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backup_api_class = cinder.backup.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backup_name_template = backup-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backup_use_same_host = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backup_use_temp_snapshot = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] chap_username = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_internal_tenant_project_id = eef95da6c7084a768fcb794df02ad962 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86495]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_internal_tenant_user_id = 595e61fe1778422db9e376a3c28f6f53 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cluster = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] compression_format = gzip {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] compute_api_class = cinder.compute.nova.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] config_dir = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] config_source = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] control_exchange = openstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] debug = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] default_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] default_group_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] default_volume_type = QuobyteHD {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_ssl_cert_verify = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] driver_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] enable_new_services = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] enable_unsupported_driver = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] enabled_backends = ['QuobyteHD'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] enforce_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_api_insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_api_ssl_compression = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_ca_certificates_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_catalog_info = image:glance:publicURL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_num_retries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance_request_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] graceful_shutdown_timeout = 5 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] group_api_class = cinder.group.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] host = devstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_compress_on_upload = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_conversion_address_space_limit = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_conversion_cpu_limit = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_conversion_disable = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_upload_use_cinder_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_upload_use_internal_tenant = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_volume_cache_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_volume_cache_max_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] image_volume_cache_max_size_gb = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] init_host_max_objects_retrieval = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] instance_format = [instance: %(uuid)s] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iscsi_target_flags = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iscsi_write_cache = on {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iser_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iser_ip_address = 192.168.122.6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iser_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_color = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_config_append = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_options = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_rotate_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_rotate_interval_type = days {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] log_rotation_type = none {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] max_age = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] max_logfile_count = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] max_logfile_size_mb = 200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] max_over_subscription_ratio = 20.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] message_reap_interval = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] message_ttl = 2592000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] migration_create_volume_timeout_secs = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] monkey_patch = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] monkey_patch_modules = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] my_ip = 192.168.122.6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] no_snapshot_gb_quota = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] num_iser_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] num_shell_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] num_volume_device_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] nvmeof_conn_info_version = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] nvmet_ns_id = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] nvmet_port_id = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_max_limit = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_ext_list = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_listen_port = 8776 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] osapi_volume_workers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] per_volume_size_limit = -1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] periodic_fuzzy_delay = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] periodic_interval = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] public_endpoint = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] publish_errors = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_backup_gigabytes = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_backups = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_gigabytes = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_groups = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_snapshots = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] quota_volumes = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] rate_limit_burst = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] rate_limit_except_level = CRITICAL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] rate_limit_interval = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] reinit_driver_count = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] report_discard_supported = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] report_interval = 120 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] reservation_clean_interval = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] reservation_expire = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] reserved_image_namespaces = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] reserved_percentage = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] rpc_response_timeout = 120 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] run_external_periodic_tasks = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] scst_target_driver = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_down_time = 720 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] shell_completion = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] snapshot_name_template = snapshot-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] state_path = /opt/stack/data/cinder {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] storage_availability_zone = nova {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] storage_protocol = iSCSI {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] syslog_log_facility = LOG_USER {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_helper = lioadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_ip_address = 192.168.122.6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_protocol = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] target_secondary_ip_addresses = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] transport_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] until_refresh = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_chap_auth = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_default_quota_class = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_journal = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_json = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_stderr = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] use_syslog = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] verify_glance_signatures = enabled {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_api_class = cinder.volume.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_clear = zero {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_clear_size = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_copy_bps_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_dd_blocksize = 1M {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_name_template = volume-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_service_inithost_offload = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volume_usage_audit_period = month {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] zoning_mode = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_concurrency.disable_process_locking = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.auth_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86495]: INFO cinder.volume.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.remotefs [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86495) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.include_service_catalog = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.interface = public {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_password = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcache_username = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.service_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.backend = dogpile.cache.null {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.backend_argument = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.backend_expiration_time = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.config_prefix = cache.oslo {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.debug_cache_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.enable_retry_client = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.enable_socket_keepalive = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.expiration_time = 600 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.hashclient_retry_attempts = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_dead_retry = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_pool_maxsize = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_sasl_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.proxies = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.redis_db = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.redis_server = localhost:6379 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.retry_attempts = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.retry_delay = 0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.socket_keepalive_count = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.socket_keepalive_idle = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.socket_keepalive_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.socket_timeout = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.tls_allowed_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.tls_cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.tls_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.tls_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.tls_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cache.username = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] coordination.backend_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.asyncio_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.asyncio_slave_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.backend = sqlalchemy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.connection_debug = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.connection_parameters = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.connection_recycle_time = 3600 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.connection_trace = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.db_inc_retry_interval = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.db_max_retries = 20 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.db_max_retry_interval = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.db_retry_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.max_overflow = 50 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.max_pool_size = 5 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.max_retries = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.mysql_wsrep_sync_wait = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.pool_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.retry_interval = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.slave_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.sqlite_synchronous = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.synchronous_reader = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] database.use_db_reconnect = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.connection_string = messaging:// {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.es_doc_type = notification {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.es_scroll_size = 10000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.es_scroll_time = 2m {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.filter_error_trace = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.hmac_keys = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.sentinel_service_name = mymaster {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.socket_timeout = 0.1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.trace_requests = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler.trace_sqlalchemy = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler_jaeger.process_tags = {} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler_jaeger.service_name_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] profiler_otlp.service_name_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.enforce_new_defaults = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.enforce_scope = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.policy_default_rule = default {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.policy_file = policy.yaml {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.group = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.helper_command = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] privsep_osbrick.user = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.group = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.helper_command = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] cinder_sys_admin.user = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.send_service_user_token = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] service_user.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] glance.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.chap_username = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86495) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 02:43:26 devstack cinder-volume[86495]: WARNING cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 02:43:26 devstack cinder-volume[86495]: WARNING cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.driver_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.extra_capabilities = {} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iscsi_target_flags = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iscsi_write_cache = on {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Running cmd (subprocess): mount.quobyte {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iser_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iser_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_host = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_login = admin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_mount_options = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_private_key = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_share_path = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.num_shell_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.quobyte_volume_url = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.report_discard_supported = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.reserved_percentage = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_protocol = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.unique_fqdn_network = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.use_chap_auth = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_clear = zero {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_clear_size = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_reports.file_event_handler = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_reports.log_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.backend_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.chap_username = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.chiscsi_conf = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.driver_use_ssl = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.extra_capabilities = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iser_helper = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iser_ip_address = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iser_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.iser_target_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_login = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_mount_options = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_private_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_share_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_ssh_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.num_shell_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.nvmet_port_id = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.report_discard_supported = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.reserved_percentage = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.scst_target_driver = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.storage_protocol = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_helper = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_ip_address = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_protocol = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.use_chap_auth = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_clear = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_clear_size = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] QuobyteHD.volumes_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_notifications.driver = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_notifications.retry = -1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] key_manager.fixed_key = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.barbican_api_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.barbican_endpoint = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.barbican_endpoint_type = public {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.barbican_region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.number_of_retries = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.retry_delay = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.send_service_user_token = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.verify_ssl = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican.verify_ssl_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.auth_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] barbican_service_user.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.approle_role_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.approle_secret_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.kv_mountpoint = secret {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.kv_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.kv_version = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.root_token_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.ssl_ca_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:26 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] ******************************************************************************** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=86495) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:26 devstack cinder-volume[86495]: INFO cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 ... Jul 09 02:43:26 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b -c /etc/quobyte/client-cinder.cfg {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:26 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b -c /etc/quobyte/client-cinder.cfg Jul 09 02:43:26 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:27 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:27 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.785s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:27 devstack cinder-volume[86495]: INFO cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 succeeded Jul 09 02:43:27 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=86495) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:27 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.814s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:27 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:27 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:27 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:28 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.678s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:28 devstack cinder-volume[86495]: INFO cinder.volume.driver [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Driver hasn't implemented _init_vendor_properties() Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG cinder.volume.driver [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86495) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86495) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG dbcounter [-] [86495] Writer thread running {{(pid=86495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG cinder.db.api [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Building query based on filter {{(pid=86495) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG cinder.image.image_utils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86495) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 02:43:28 devstack cinder-volume[86495]: INFO cinder.keymgr.migration [None req-59789221-1f44-40b9-98e1-a90a79c002e4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=86495) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=86495) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:28 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:28 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:28 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:29 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.867s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG cinder.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Notifying Schedulers of capabilities ... {{(pid=86495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:43:29 devstack cinder-volume[86495]: INFO cinder.volume.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Driver initialization completed successfully. Jul 09 02:43:29 devstack cinder-volume[86495]: INFO cinder.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Initiating service 3 cleanup Jul 09 02:43:29 devstack cinder-volume[86495]: INFO cinder.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Service 3 cleanup completed. Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG cinder.service [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Creating RPC server for service cinder-volume {{(pid=86495) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG cinder.service [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86495) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 02:43:29 devstack cinder-volume[86495]: INFO cinder.volume.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=86495) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=86495) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:29 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:29 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:29 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:30 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:30 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.972s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:30 devstack cinder-volume[86495]: INFO cinder.volume.manager [None req-ff2de27d-ca3f-4dc5-8d16-e97489fced3f None None] Driver post RPC initialization completed successfully. Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=86495) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG cinder.volume.drivers.quobyte [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=86495) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86495) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:33 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:33 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:33 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG oslo_concurrency.processutils [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.639s {{(pid=86495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:33 devstack cinder-volume[86495]: DEBUG cinder.manager [None req-5ef76178-60b9-491c-bc6e-000c2b879951 None None] Notifying Schedulers of capabilities ... {{(pid=86495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG dbcounter [-] [86281] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86281) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:43:36 devstack cinder-volume[86281]: INFO oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Caught SIGTERM, stopping children Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Acquiring lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Acquired lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Releasing lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Stop services. {{(pid=86281) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 02:43:36 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Killing children. {{(pid=86281) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 02:43:36 devstack cinder-volume[86281]: INFO oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Waiting on 1 children to exit Jul 09 02:43:37 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Acquiring lock "singleton_lock" {{(pid=86495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:37 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Acquired lock "singleton_lock" {{(pid=86495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:37 devstack cinder-volume[86495]: DEBUG oslo_concurrency.lockutils [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Releasing lock "singleton_lock" {{(pid=86495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:37 devstack cinder-volume[86495]: WARNING amqp [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 02:43:37 devstack cinder-volume[86495]: WARNING amqp [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 02:43:37 devstack cinder-volume[86281]: INFO oslo_service.backend._eventlet.service [None req-6361bc81-02c0-498f-b334-7ce0911ac30e None None] Child 86495 exited with status 0 Jul 09 02:43:38 devstack cinder-volume[86853]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 02:43:38 devstack cinder-volume[86853]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:43:38 devstack cinder-volume[86853]: we strongly recommend against using it for new projects. Jul 09 02:43:38 devstack cinder-volume[86853]: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:43:38 devstack cinder-volume[86853]: framework. For more detail see Jul 09 02:43:38 devstack cinder-volume[86853]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:43:38 devstack cinder-volume[86853]: import eventlet # noqa Jul 09 02:43:41 devstack cinder-volume[86853]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 02:43:41 devstack cinder-volume[86853]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 02:43:41 devstack cinder-volume[86853]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86853) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 02:43:42 devstack cinder-volume[86853]: INFO dbcounter [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Registered counter for database cinder Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_db.sqlalchemy.engines [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86853) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG dbcounter [-] [86853] Writer thread running {{(pid=86853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:43:42 devstack cinder-volume[86853]: INFO cinder.rpc [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 02:43:42 devstack cinder-volume[86853]: INFO cinder.rpc [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_db.sqlalchemy.engines [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86853) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:42 devstack cinder-volume[86853]: INFO cinder.volume.manager [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Determined volume DB was empty at startup. Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG cinder.volume.manager [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86853) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 02:43:42 devstack cinder-volume[86853]: WARNING stevedore.named [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 02:43:42 devstack cinder-volume[86853]: WARNING castellan.key_manager [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:43:42 devstack cinder-volume[86853]: WARNING cinder.keymgr.conf_key_mgr [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 02:43:42 devstack cinder-volume[86853]: INFO cinder.volume.manager [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_db.sqlalchemy.engines [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86853) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:42 devstack cinder-volume[86853]: INFO oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Starting 1 workers Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Started child 87156 {{(pid=86853) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Full set of CONF: {{(pid=86853) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] ******************************************************************************** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] Configuration options gathered from: {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] ================================================================================ {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] allow_availability_zone_fallback = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] allow_compression_on_image_upload = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] allowed_direct_url_schemes = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] api_rate_limit = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] auth_strategy = keystone {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_availability_zone = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_host = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_stats_polling_interval = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backup_api_class = cinder.backup.api.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backup_name_template = backup-%s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backup_use_same_host = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backup_use_temp_snapshot = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] chap_password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] chap_username = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_internal_tenant_project_id = eef95da6c7084a768fcb794df02ad962 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_internal_tenant_user_id = 595e61fe1778422db9e376a3c28f6f53 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cluster = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] compression_format = gzip {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] compute_api_class = cinder.compute.nova.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[87156]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] config_dir = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] config_source = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] control_exchange = openstack {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] debug = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] default_availability_zone = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] default_group_type = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] default_volume_type = QuobyteHD {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] disk_geometry = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_client_cert = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_client_cert_key = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_data_namespace = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_ssl_cert_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_ssl_cert_verify = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] driver_use_ssl = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] enable_new_services = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] enable_unsupported_driver = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] enabled_backends = ['QuobyteHD'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] enforce_multipath_for_image_xfer = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] filter_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_api_insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_api_ssl_compression = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_ca_certificates_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_catalog_info = image:glance:publicURL {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_num_retries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance_request_timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] goodness_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] graceful_shutdown_timeout = 5 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] group_api_class = cinder.group.api.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] host = devstack {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_compress_on_upload = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_conversion_address_space_limit = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_conversion_cpu_limit = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_conversion_disable = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_upload_use_cinder_backend = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_upload_use_internal_tenant = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_volume_cache_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_volume_cache_max_count = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] image_volume_cache_max_size_gb = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] init_host_max_objects_retrieval = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] instance_format = [instance: %(uuid)s] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iscsi_target_flags = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iscsi_write_cache = on {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iser_helper = tgtadm {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iser_ip_address = 192.168.122.6 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iser_port = 3260 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_color = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:42 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_config_append = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_dir = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_options = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_rotate_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_rotate_interval_type = days {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] log_rotation_type = none {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] max_age = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] max_logfile_count = 30 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] max_logfile_size_mb = 200 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] max_over_subscription_ratio = 20.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] message_reap_interval = 86400 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] message_ttl = 2592000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] migration_create_volume_timeout_secs = 300 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] monkey_patch = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] monkey_patch_modules = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] my_ip = 192.168.122.6 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] no_snapshot_gb_quota = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] num_iser_scan_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] num_shell_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] num_volume_device_scan_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] nvmeof_conn_info_version = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] nvmet_ns_id = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] nvmet_port_id = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_max_limit = 1000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_ext_list = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_listen = 0.0.0.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_listen_port = 8776 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_use_ssl = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] osapi_volume_workers = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] per_volume_size_limit = -1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] periodic_fuzzy_delay = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] periodic_interval = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] project_id_regex = [0-9a-f\-]+ {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] public_endpoint = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] publish_errors = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_backup_gigabytes = 1000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_backups = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_gigabytes = 1000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_groups = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_snapshots = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] quota_volumes = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] rate_limit_burst = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] rate_limit_except_level = CRITICAL {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] rate_limit_interval = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] reinit_driver_count = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] replication_device = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] report_discard_supported = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] report_interval = 120 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] reservation_clean_interval = 86400 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] reservation_expire = 86400 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] reserved_image_namespaces = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] reserved_percentage = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] rpc_response_timeout = 120 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] run_external_periodic_tasks = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] scst_target_driver = iscsi {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] scst_target_iqn_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_down_time = 720 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] shell_completion = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] snapshot_name_template = snapshot-%s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] split_loggers = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] state_path = /opt/stack/data/cinder {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] storage_availability_zone = nova {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] storage_protocol = iSCSI {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] syslog_log_facility = LOG_USER {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_helper = lioadm {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_ip_address = 192.168.122.6 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_port = 3260 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_protocol = iscsi {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] target_secondary_ip_addresses = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] trace_flags = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] transfer_api_class = cinder.transfer.api.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] transport_url = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] until_refresh = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_chap_auth = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_default_quota_class = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_journal = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_json = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_multipath_for_image_xfer = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_stderr = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] use_syslog = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] verify_glance_signatures = enabled {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_api_class = cinder.volume.api.API {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_backend_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_clear = zero {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_clear_ionice = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_clear_size = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_copy_bps_limit = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_dd_blocksize = 1M {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_name_template = volume-%s {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_service_inithost_offload = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volume_usage_audit_period = month {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] zoning_mode = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_concurrency.disable_process_locking = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.auth_section = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.auth_type = password {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.auth_version = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.cache = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.delay_auth_decision = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.http_connect_timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.include_service_catalog = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.interface = public {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_password = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcache_username = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.region_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.service_token_roles_required = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.service_type = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.token_cache_time = 300 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.backend = dogpile.cache.null {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.backend_argument = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.backend_expiration_time = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.config_prefix = cache.oslo {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.debug_cache_backend = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.enable_retry_client = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.enable_socket_keepalive = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.expiration_time = 600 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.hashclient_retry_attempts = 2 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_dead_retry = 300 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_pool_maxsize = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_sasl_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.proxies = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.redis_db = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.redis_sentinel_service_name = mymaster {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.redis_server = localhost:6379 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.retry_attempts = 2 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.retry_delay = 0.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.socket_keepalive_count = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.socket_keepalive_idle = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.socket_keepalive_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.socket_timeout = 1.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.tls_allowed_ciphers = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.tls_cafile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.tls_certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.tls_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.tls_keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cache.username = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] coordination.backend_url = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.asyncio_connection = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.asyncio_slave_connection = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.backend = sqlalchemy {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.connection = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87156) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.connection_debug = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.connection_parameters = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.connection_recycle_time = 3600 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.connection_trace = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.db_inc_retry_interval = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.db_max_retries = 20 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.db_max_retry_interval = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.db_retry_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.max_overflow = 50 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.max_pool_size = 5 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.max_retries = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.mysql_wsrep_sync_wait = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.pool_timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.retry_interval = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.slave_connection = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.sqlite_synchronous = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.synchronous_reader = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] database.use_db_reconnect = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.connection_string = messaging:// {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.es_doc_type = notification {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.es_scroll_size = 10000 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.es_scroll_time = 2m {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.filter_error_trace = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.hmac_keys = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.sentinel_service_name = mymaster {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.socket_timeout = 0.1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.trace_requests = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler.trace_sqlalchemy = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler_jaeger.process_tags = {} {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler_jaeger.service_name_prefix = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] profiler_otlp.service_name_prefix = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.enforce_new_defaults = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.enforce_scope = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.policy_default_rule = default {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.policy_file = policy.yaml {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_policy.remote_timeout = 60.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.group = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.helper_command = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] privsep_osbrick.user = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.group = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.helper_command = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] cinder_sys_admin.user = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.auth_section = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.auth_type = password {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.cafile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.collect_timing = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.send_service_user_token = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.split_loggers = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] service_user.timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.auth_section = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.auth_type = password {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.collect_timing = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.region_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.split_loggers = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] glance.timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.backend_availability_zone = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.chap_password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.chap_username = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.disk_geometry = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_client_cert = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_client_cert_key = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_data_namespace = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.driver_use_ssl = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.enable_unsupported_driver = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.extra_capabilities = {} {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.filter_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.goodness_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iscsi_target_flags = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iscsi_write_cache = on {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iser_helper = tgtadm {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iser_port = 3260 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_host = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_login = admin {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_mount_options = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_private_key = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_share_path = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_ssh_port = 22 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.num_shell_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.nvmet_port_id = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_client_cfg = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.quobyte_volume_url = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.replication_device = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.report_discard_supported = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.reserved_percentage = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.scst_target_driver = iscsi {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.scst_target_iqn_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.storage_protocol = iSCSI {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_helper = tgtadm {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_port = 3260 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_protocol = iscsi {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.trace_flags = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.unique_fqdn_network = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.use_chap_auth = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_backend_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_clear = zero {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_clear_ionice = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_clear_size = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_reports.file_event_handler = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_reports.log_dir = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.backend_availability_zone = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.backend_host = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.chap_password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.chap_username = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.chiscsi_conf = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.disk_geometry = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_client_cert = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_client_cert_key = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_data_namespace = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.driver_use_ssl = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.extra_capabilities = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.filter_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.goodness_function = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iscsi_target_flags = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iscsi_write_cache = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iser_helper = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iser_ip_address = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iser_port = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.iser_target_prefix = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_host = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_login = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_mount_options = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_password = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_private_key = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_share_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_ssh_port = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.num_shell_tries = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nvmet_ns_id = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.nvmet_port_id = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.replication_device = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.report_discard_supported = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.reserved_percentage = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.scst_target_driver = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.storage_protocol = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_helper = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_ip_address = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_port = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_prefix = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_protocol = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.trace_flags = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.unique_fqdn_network = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.use_chap_auth = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_clear = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_clear_ionice = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_clear_size = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] QuobyteHD.volumes_dir = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.ssl_version = {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_notifications.driver = [] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_notifications.retry = -1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] oslo_messaging_notifications.transport_url = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87156) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 02:43:43 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] key_manager.fixed_key = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Running cmd (subprocess): mount.quobyte {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.barbican_api_version = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.barbican_endpoint = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.barbican_endpoint_type = public {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.barbican_region_name = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.cafile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.collect_timing = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.number_of_retries = 60 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.retry_delay = 1 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.send_service_user_token = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.split_loggers = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.verify_ssl = True {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican.verify_ssl_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.auth_section = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.auth_type = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.cafile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.certfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.collect_timing = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.insecure = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.keyfile = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.split_loggers = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] barbican_service_user.timeout = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.approle_role_id = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.approle_secret_id = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.kv_mountpoint = secret {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.kv_path = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.kv_version = 2 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.namespace = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.root_token_id = **** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.ssl_ca_crt_file = None {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.timeout = 60.0 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.use_ssl = False {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 02:43:43 devstack cinder-volume[86853]: DEBUG oslo_service.backend._eventlet.service [None req-7b83d017-95f6-4368-86db-75129f2fd9df None None] ******************************************************************************** {{(pid=86853) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 02:43:43 devstack quobyte-client[87170]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 02:43:43 devstack quobyte-client[87170]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] CMD "mount.quobyte" returned: 1 in 0.144s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:43 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:43 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:44 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.810s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:44 devstack cinder-volume[87156]: INFO cinder.volume.driver [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Driver hasn't implemented _init_vendor_properties() Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG cinder.volume.driver [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87156) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writer thread running {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG cinder.db.api [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Building query based on filter {{(pid=87156) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87156) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:44 devstack cinder-volume[87156]: INFO cinder.keymgr.migration [None req-5daf0bb3-8228-419c-944b-419a285ffe59 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 02:43:44 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:44 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:45 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.759s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:43:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Driver initialization completed successfully. Jul 09 02:43:45 devstack cinder-volume[87156]: INFO cinder.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Initiating service 3 cleanup Jul 09 02:43:45 devstack cinder-volume[87156]: INFO cinder.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Service 3 cleanup completed. Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG cinder.service [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Creating RPC server for service cinder-volume {{(pid=87156) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG cinder.service [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87156) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 02:43:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:43:45 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:43:45 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:43:45 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Jul 09 02:43:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.620s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:43:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0d64f0d-f03d-45cd-9dec-e340cba9ca2d None None] Driver post RPC initialization completed successfully. Jul 09 02:43:52 devstack cinder-volume[86853]: DEBUG dbcounter [-] [86853] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86853) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:43:55 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=3 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:43:55 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:44:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:44:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 6 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:44:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Flow 'volume_create_manager' (acfa0922-f747-4691-866f-39bca8ef3118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71447c26-6e4a-4155-abcf-a88953d22b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71447c26-6e4a-4155-abcf-a88953d22b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1166142189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f34fa69-d61b-4787-992f-8c9c307fcc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08506f921343758f75973801bff750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:44:46Z,use_quota=True,user_id='a3d0b666ff7140948ff18870c822c46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c5dc12-2e69-4dc6-9b38-d5f04d8fa4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c5dc12-2e69-4dc6-9b38-d5f04d8fa4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6184d7-df08-481f-995f-77f328715fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6184d7-df08-481f-995f-77f328715fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f34fa69-d61b-4787-992f-8c9c307fcc59', 'volume_name': 'volume-8f34fa69-d61b-4787-992f-8c9c307fcc59', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37adb235-61c2-4d84-8e73-a16334587a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37adb235-61c2-4d84-8e73-a16334587a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37501d4e-fea9-491a-86cb-db546fef7d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Volume 8f34fa69-d61b-4787-992f-8c9c307fcc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f34fa69-d61b-4787-992f-8c9c307fcc59', 'volume_size': 1} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1166142189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f34fa69-d61b-4787-992f-8c9c307fcc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08506f921343758f75973801bff750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:44:46Z,use_quota=True,user_id='a3d0b666ff7140948ff18870c822c46e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Creating volume 8f34fa69-d61b-4787-992f-8c9c307fcc59 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:44:46 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:44:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:44:46 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 1073741824 Jul 09 02:44:46 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:44:47 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Jul 09 02:44:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 1073741824" returned: 0 in 1.120s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:44:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:44:47 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 Jul 09 02:44:47 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:44:48 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59" returned: 0 in 1.060s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37501d4e-fea9-491a-86cb-db546fef7d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f34fa69-d61b-4787-992f-8c9c307fcc59', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35be28-fa19-4fae-94c1-00e1f917b614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:44:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Volume volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 (8f34fa69-d61b-4787-992f-8c9c307fcc59): created successfully Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35be28-fa19-4fae-94c1-00e1f917b614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:44:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Flow 'volume_create_manager' (acfa0922-f747-4691-866f-39bca8ef3118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:44:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f2bf015f-a3ac-44ee-8e5c-31e2efc45903 tempest-TaggedAttachmentsTest-291712073 None] Created volume successfully. Jul 09 02:44:58 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:44:58 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Flow 'volume_create_manager' (c3a4cf67-5c0a-46fe-b934-a4877d7fe30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd96e0e-bd58-4907-96a9-805062809cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd96e0e-bd58-4907-96a9-805062809cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-403230333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240fa9f-57a7-4c1d-9c9f-6f85eae85831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec83eaec0214564b55886bc1aaa8ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:23Z,use_quota=True,user_id='661b768d781f45348e80654f922741f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd4b70a-062e-476c-85d2-eaf334805424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd4b70a-062e-476c-85d2-eaf334805424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d24ac65-0444-4345-b8b9-323f17b410b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d24ac65-0444-4345-b8b9-323f17b410b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'volume_name': 'volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047c3cf5-a521-4d53-a376-49dc4549524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047c3cf5-a521-4d53-a376-49dc4549524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ca6195-ff11-4d3d-8011-605cfda630f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:22 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Volume 8240fa9f-57a7-4c1d-9c9f-6f85eae85831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'volume_size': 1} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-403230333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240fa9f-57a7-4c1d-9c9f-6f85eae85831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec83eaec0214564b55886bc1aaa8ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:23Z,use_quota=True,user_id='661b768d781f45348e80654f922741f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Creating volume 8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:45:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:45:23 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:45:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:23 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 1073741824 Jul 09 02:45:23 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:24 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 1073741824" returned: 0 in 1.672s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:24 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 Jul 09 02:45:24 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:25 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" returned: 0 in 0.974s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] <== create_volume: return (2717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.722s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ca6195-ff11-4d3d-8011-605cfda630f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30461611-8205-4a1a-80e5-cb7ae59b7c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Volume volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 (8240fa9f-57a7-4c1d-9c9f-6f85eae85831): created successfully Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30461611-8205-4a1a-80e5-cb7ae59b7c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Flow 'volume_create_manager' (c3a4cf67-5c0a-46fe-b934-a4877d7fe30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3fe80910-cb79-462f-8614-e42ad7845dd3 tempest-ServerActionsTestOtherA-1476504921 None] Created volume successfully. Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:27 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:45:27 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:28 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.021s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:45:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:45:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 6 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:45:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Flow 'volume_create_manager' (a59dd773-b2b9-4353-9e33-5a73a25cd221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06ba9d4-2a71-4f06-ac19-d535cec809ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06ba9d4-2a71-4f06-ac19-d535cec809ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655870482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acab541f-b456-476f-9fdf-da0d66bd30ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c98af62d404046b12082279a3c9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:32Z,use_quota=True,user_id='d20021e9fa5f4f8d9bd499091492665f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695da62b-2147-4794-9ef8-c65ec1ba61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695da62b-2147-4794-9ef8-c65ec1ba61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5187b7-2871-4bd9-90f2-8b0acf6188bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5187b7-2871-4bd9-90f2-8b0acf6188bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acab541f-b456-476f-9fdf-da0d66bd30ba', 'volume_name': 'volume-acab541f-b456-476f-9fdf-da0d66bd30ba', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452cf82f-340b-4470-90d9-d474037aabe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452cf82f-340b-4470-90d9-d474037aabe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fde1d1e-17a5-488b-b56f-bc5265d91185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Volume acab541f-b456-476f-9fdf-da0d66bd30ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acab541f-b456-476f-9fdf-da0d66bd30ba', 'volume_size': 1} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655870482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acab541f-b456-476f-9fdf-da0d66bd30ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c98af62d404046b12082279a3c9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:32Z,use_quota=True,user_id='d20021e9fa5f4f8d9bd499091492665f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Creating volume acab541f-b456-476f-9fdf-da0d66bd30ba {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:45:31 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:45:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:32 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba 1073741824 Jul 09 02:45:32 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:33 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba 1073741824" returned: 0 in 1.421s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:33 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba Jul 09 02:45:33 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:34 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba" returned: 0 in 0.808s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fde1d1e-17a5-488b-b56f-bc5265d91185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acab541f-b456-476f-9fdf-da0d66bd30ba', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501d5bf6-711f-44e1-9e07-d43aba87a9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:34 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Volume volume-acab541f-b456-476f-9fdf-da0d66bd30ba (acab541f-b456-476f-9fdf-da0d66bd30ba): created successfully Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501d5bf6-711f-44e1-9e07-d43aba87a9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Flow 'volume_create_manager' (a59dd773-b2b9-4353-9e33-5a73a25cd221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2e6d1180-a1ce-4b44-970f-ab12d2e3f881 tempest-ServersNegativeTestJSON-2112941136 None] Created volume successfully. Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Flow 'volume_create_manager' (15f5d9e4-c578-4d2d-9b21-e47b933fe17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d20f47-0893-43e8-8f98-467ba2a91ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d20f47-0893-43e8-8f98-467ba2a91ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-866049963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938d9229-41ce-4fe6-8342-c8cfa14bd59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c98af62d404046b12082279a3c9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:37Z,use_quota=True,user_id='d20021e9fa5f4f8d9bd499091492665f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8a23cf-5bd7-4e37-92d6-ef8e0d13ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8a23cf-5bd7-4e37-92d6-ef8e0d13ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec81d197-7f19-4ac0-a637-d7efdfa2ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec81d197-7f19-4ac0-a637-d7efdfa2ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938d9229-41ce-4fe6-8342-c8cfa14bd59f', 'volume_name': 'volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db4f568-8f54-46f9-b1af-54abed269c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db4f568-8f54-46f9-b1af-54abed269c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfc4d06-6500-4fe2-9974-0b025012cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Volume 938d9229-41ce-4fe6-8342-c8cfa14bd59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f', 'volume_size': 1} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-866049963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938d9229-41ce-4fe6-8342-c8cfa14bd59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c98af62d404046b12082279a3c9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:45:37Z,use_quota=True,user_id='d20021e9fa5f4f8d9bd499091492665f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Creating volume 938d9229-41ce-4fe6-8342-c8cfa14bd59f {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:45:37 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:45:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:37 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f 1073741824 Jul 09 02:45:37 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:38 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f 1073741824" returned: 0 in 1.013s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:38 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f Jul 09 02:45:38 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:39 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f" returned: 0 in 0.879s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfc4d06-6500-4fe2-9974-0b025012cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4ce591-d386-41d0-91b5-c9117c159229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:45:39 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Volume volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f (938d9229-41ce-4fe6-8342-c8cfa14bd59f): created successfully Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4ce591-d386-41d0-91b5-c9117c159229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:45:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Flow 'volume_create_manager' (15f5d9e4-c578-4d2d-9b21-e47b933fe17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:45:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d19aa290-24f9-4964-b0de-4687fe7bcde7 tempest-ServersNegativeTestJSON-2112941136 None] Created volume successfully. Jul 09 02:45:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "cinder-938d9229-41ce-4fe6-8342-c8cfa14bd59f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:45:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-938d9229-41ce-4fe6-8342-c8cfa14bd59f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:45:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "cinder-quobyte-938d9229-41ce-4fe6-8342-c8cfa14bd59f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:45:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-quobyte-938d9229-41ce-4fe6-8342-c8cfa14bd59f" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:45:40 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnhuwqup7/privsep.sock'] Jul 09 02:45:40 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnhuwqup7/privsep.sock Jul 09 02:45:40 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 02:45:41 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 02:45:42 devstack cinder-volume[87156]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 02:45:42 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:42 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Spawned new privsep daemon via rootwrap Jul 09 02:45:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Accepted privsep connection to /tmp/tmpnhuwqup7/privsep.sock {{(pid=87156) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 02:45:42 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 02:45:42 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 02:45:42 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 02:45:42 devstack cinder-volume[87156]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88483 Jul 09 02:45:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[797540fb-2872-42dc-afec-2e7d472fcc91]: (2,) {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:45:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3fe09d-9a90-42fa-a7ee-ed6b388c89e3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:45:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:42 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f Jul 09 02:45:42 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:43 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f" returned: 0 in 1.106s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:43 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f Jul 09 02:45:43 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:44 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-938d9229-41ce-4fe6-8342-c8cfa14bd59f" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-quobyte-938d9229-41ce-4fe6-8342-c8cfa14bd59f" released by "delete_volume" :: held 3.991s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:45:44 devstack cinder-volume[87156]: WARNING cinder.quota [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:45:44 devstack cinder-volume[87156]: WARNING cinder.quota [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:45:44 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Created reservations ['3a81dc2c-1fb7-4891-8a68-9f8579f79468', '5b61017a-7e57-4a95-8238-66cd92ce8c2e', '5d089cce-49ae-4a1d-99cc-4726509219ac', '83cb615a-aa47-4a99-967c-e878e8f57208'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:45 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:45:45 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "cinder-acab541f-b456-476f-9fdf-da0d66bd30ba-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-acab541f-b456-476f-9fdf-da0d66bd30ba-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "cinder-quobyte-acab541f-b456-476f-9fdf-da0d66bd30ba" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-quobyte-acab541f-b456-476f-9fdf-da0d66bd30ba" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f88de1-7fe3-4c17-8db0-fd49914fa23d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:45:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:45 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba Jul 09 02:45:45 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:46 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.279s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:46 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:45:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Deleted volume successfully. Jul 09 02:45:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-185cfaad-1cd7-4f77-9799-b766729fa14c tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-938d9229-41ce-4fe6-8342-c8cfa14bd59f-delete_volume" released by "delete_volume" :: held 5.799s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:45:46 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba" returned: 0 in 1.345s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:47 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba Jul 09 02:45:47 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:48 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-acab541f-b456-476f-9fdf-da0d66bd30ba" returned: 0 in 1.118s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-quobyte-acab541f-b456-476f-9fdf-da0d66bd30ba" released by "delete_volume" :: held 2.549s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Created reservations ['d5b49b89-8ce4-4b94-bc5e-615c38377d23', 'e9faa4c2-4a09-4c04-9fec-542cfecc3725', '53a75509-4bc0-41dc-81e0-7590492f67b1', 'b3d724c2-9c50-4700-8ee0-06726f512851'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:45:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:45:48 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:45:48 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:45:49 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Jul 09 02:45:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.022s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:45:49 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:45:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Deleted volume successfully. Jul 09 02:45:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b5ba30d4-3d85-495c-9222-cf35b3fad222 tempest-ServersNegativeTestJSON-2112941136 None] Lock "cinder-acab541f-b456-476f-9fdf-da0d66bd30ba-delete_volume" released by "delete_volume" :: held 4.065s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:45:58 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=28,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:45:59 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:46:09 devstack cinder-volume[87156]: WARNING py.warnings [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 09 02:46:09 devstack cinder-volume[87156]: .first() Jul 09 02:46:09 devstack cinder-volume[87156]: Jul 09 02:46:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7708c-39c3-4d99-b71d-d84853707059]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:46:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:09 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 Jul 09 02:46:09 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:10 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59" returned: 0 in 1.115s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.168s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-8f34fa69-d61b-4787-992f-8c9c307fcc59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67a7a110-99c5-4c44-aacd-b5c1162bbf6f', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:46:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-7e507834-347c-4100-a54f-7f58d9244c03 req-6d62b88a-e134-400d-9586-1716d24af50e tempest-TaggedAttachmentsTest-291712073 None] attachment_update completed successfully. Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Flow 'volume_create_manager' (e5f8af32-8868-41a9-bc20-fdf2da9a51b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a099a-f55e-478f-badc-799a52a84ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a099a-f55e-478f-badc-799a52a84ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-910276605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ea3a67-9376-4cdb-b1de-cc6729853f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4719fd0bd9f44af99a333098f3f22180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:46:12Z,use_quota=True,user_id='7f4dbd8f307446de81ba19aa3eb15c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f3e6b-3a76-4707-8adb-82ae5d35e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f3e6b-3a76-4707-8adb-82ae5d35e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac897739-6c00-46a2-92d0-b7bd7a9fed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac897739-6c00-46a2-92d0-b7bd7a9fed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ea3a67-9376-4cdb-b1de-cc6729853f8d', 'volume_name': 'volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716c4cd1-a232-4956-8552-7a54862a8c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716c4cd1-a232-4956-8552-7a54862a8c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ac8a1c-e56c-4944-b1af-9f2572347ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Volume 52ea3a67-9376-4cdb-b1de-cc6729853f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d', 'volume_size': 1} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-910276605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ea3a67-9376-4cdb-b1de-cc6729853f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4719fd0bd9f44af99a333098f3f22180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:46:12Z,use_quota=True,user_id='7f4dbd8f307446de81ba19aa3eb15c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Creating volume 52ea3a67-9376-4cdb-b1de-cc6729853f8d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:46:12 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:46:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:12 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d 1073741824 Jul 09 02:46:12 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:13 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d 1073741824" returned: 0 in 1.057s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:13 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d Jul 09 02:46:13 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:14 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d" returned: 0 in 0.865s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.044s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ac8a1c-e56c-4944-b1af-9f2572347ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332c9958-8b5f-420f-9157-f8afa4f853f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9654de7-9324-47bb-89ac-fc84c66edd02]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:14 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Volume volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d (52ea3a67-9376-4cdb-b1de-cc6729853f8d): created successfully Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332c9958-8b5f-420f-9157-f8afa4f853f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:46:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Flow 'volume_create_manager' (e5f8af32-8868-41a9-bc20-fdf2da9a51b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:46:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-94c6951f-04d1-4205-ac09-b2346e88dcb8 tempest-VolumesAdminNegativeTest-546712967 None] Created volume successfully. Jul 09 02:46:14 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 Jul 09 02:46:14 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:15 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" returned: 0 in 1.504s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.544s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ddcfb26-cd12-407b-9303-5899dcb28e9c', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:46:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-67b85bdf-3f08-4bdf-a640-d566e682898e req-56df727e-d9fc-4f11-8407-c07b578254be tempest-ServerActionsTestOtherA-1476504921 None] attachment_update completed successfully. Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Acquiring lock "cinder-52ea3a67-9376-4cdb-b1de-cc6729853f8d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "cinder-52ea3a67-9376-4cdb-b1de-cc6729853f8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Acquiring lock "cinder-quobyte-52ea3a67-9376-4cdb-b1de-cc6729853f8d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "cinder-quobyte-52ea3a67-9376-4cdb-b1de-cc6729853f8d" acquired by "delete_volume" :: waited 0.050s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd59d33-def4-4a11-b8f4-e59216298726]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:46:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:16 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d Jul 09 02:46:16 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:17 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d" returned: 0 in 1.305s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:17 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d Jul 09 02:46:17 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-5420aa6b-796f-4426-ad25-d21e58bb75ee req-0f7f7cfd-b739-4373-ad1c-e666b3d0288e tempest-TaggedAttachmentsTest-291712073 None] Terminate volume connection completed successfully. Jul 09 02:46:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-5420aa6b-796f-4426-ad25-d21e58bb75ee req-0f7f7cfd-b739-4373-ad1c-e666b3d0288e tempest-TaggedAttachmentsTest-291712073 None] Deleting attachment 67a7a110-99c5-4c44-aacd-b5c1162bbf6f. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:46:18 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52ea3a67-9376-4cdb-b1de-cc6729853f8d" returned: 0 in 1.153s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "cinder-quobyte-52ea3a67-9376-4cdb-b1de-cc6729853f8d" released by "delete_volume" :: held 2.578s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Created reservations ['2eedc18c-e6d3-4138-8dfb-0c47440a409c', '1ef897b1-bfe7-41c4-8d12-b368a5b1652d', 'ef2e9f7c-8079-4033-86ac-dd3c7501bcc4', '623d6db1-0312-4d8f-b8c6-da4e59e40a96'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:19 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:46:19 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:21 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.886s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:21 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:46:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Deleted volume successfully. Jul 09 02:46:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8ed103c-32cf-4220-80af-e50d5b36cd48 tempest-VolumesAdminNegativeTest-546712967 None] Lock "cinder-52ea3a67-9376-4cdb-b1de-cc6729853f8d-delete_volume" released by "delete_volume" :: held 4.933s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:46:24 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-7c582766-0ceb-4aef-bb84-626f2e7e54ff tempest-ServerActionsTestOtherA-1476504921 None] Terminate volume connection completed successfully. Jul 09 02:46:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-7c582766-0ceb-4aef-bb84-626f2e7e54ff tempest-ServerActionsTestOtherA-1476504921 None] Deleting attachment 9ddcfb26-cd12-407b-9303-5899dcb28e9c. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[58960383-34eb-4b98-bb22-2c185d12d494]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:27 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 Jul 09 02:46:27 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:27 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:46:27 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:28 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" returned: 0 in 0.845s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6480de2d-c652-4195-aad6-3f47c9b3cb70', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:46:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-cc92b18e-3a4b-4cc2-904a-3de6eedf3041 req-d75506e6-756d-47b7-b932-ad53f32d5809 tempest-ServerActionsTestOtherA-1476504921 None] attachment_update completed successfully. Jul 09 02:46:28 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.732s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:46:38 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=23,cinder:UPDATE=21,cinder:INSERT=2 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:46:38 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=28,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "cinder-8f34fa69-d61b-4787-992f-8c9c307fcc59-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "cinder-8f34fa69-d61b-4787-992f-8c9c307fcc59-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "cinder-quobyte-8f34fa69-d61b-4787-992f-8c9c307fcc59" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "cinder-quobyte-8f34fa69-d61b-4787-992f-8c9c307fcc59" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e84200-3513-46b4-af93-9b8bd7c6f6db]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:46:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:41 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 Jul 09 02:46:41 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:42 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59" returned: 0 in 1.462s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:42 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59 Jul 09 02:46:42 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:43 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f34fa69-d61b-4787-992f-8c9c307fcc59" returned: 0 in 0.931s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "cinder-quobyte-8f34fa69-d61b-4787-992f-8c9c307fcc59" released by "delete_volume" :: held 2.457s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Created reservations ['d050617b-a515-4280-9b2d-2663aebd88d8', '179f4d33-60f7-4778-ac22-943bd74b1c05', 'bfc122a7-c362-4d48-860e-9801d0fcd646', '3e45d5a4-debc-4a26-86aa-b13f1e3c4a2e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:46:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:46:44 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:46:44 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:46:45 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Jul 09 02:46:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.207s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:46:45 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:46:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Deleted volume successfully. Jul 09 02:46:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4e9b587c-ba60-488d-b681-1982f90d59b8 tempest-TaggedAttachmentsTest-291712073 None] Lock "cinder-8f34fa69-d61b-4787-992f-8c9c307fcc59-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:46:54 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=3 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:46:55 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:46:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-fe720f31-449e-4039-bbdd-2802525044eb req-df735052-f554-4668-8cd9-4d2a70077b76 tempest-ServerActionsTestOtherA-1476504921 None] Terminate volume connection completed successfully. Jul 09 02:46:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-fe720f31-449e-4039-bbdd-2802525044eb req-df735052-f554-4668-8cd9-4d2a70077b76 tempest-ServerActionsTestOtherA-1476504921 None] Deleting attachment 6480de2d-c652-4195-aad6-3f47c9b3cb70. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:47:09 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:47:09 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (142341e8-d3d2-4e11-aef5-b2ef2fe7bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b7c6d-d2db-4d8e-9c90-d7a2a267f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b7c6d-d2db-4d8e-9c90-d7a2a267f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1196840328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad9f386-e55e-4a0e-b1e0-c81b6e957de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:47:12Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be40ffcb-8832-4560-aec4-c5ad70488e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be40ffcb-8832-4560-aec4-c5ad70488e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9717c645-3a07-459b-8e07-535b57c4787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9717c645-3a07-459b-8e07-535b57c4787e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad9f386-e55e-4a0e-b1e0-c81b6e957de9', 'volume_name': 'volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70215e2d-af0f-44af-87b6-5804c1426281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70215e2d-af0f-44af-87b6-5804c1426281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4f22d2-9251-4535-b54f-c4273d8d9a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Volume 3ad9f386-e55e-4a0e-b1e0-c81b6e957de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9', 'volume_size': 1} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1196840328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad9f386-e55e-4a0e-b1e0-c81b6e957de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:47:12Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Creating volume 3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:47:11 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:47:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:12 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 1073741824 Jul 09 02:47:12 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:13 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 1073741824" returned: 0 in 1.215s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:13 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 Jul 09 02:47:13 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:14 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" returned: 0 in 0.780s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4f22d2-9251-4535-b54f-c4273d8d9a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d7aca-0d26-47aa-b58e-e449a2d97e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:14 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Volume volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 (3ad9f386-e55e-4a0e-b1e0-c81b6e957de9): created successfully Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d7aca-0d26-47aa-b58e-e449a2d97e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (142341e8-d3d2-4e11-aef5-b2ef2fe7bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:47:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d3e29608-be49-4f2d-b364-ce2f66ae067f tempest-AttachVolumeNegativeTest-1597436921 None] Created volume successfully. Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "cinder-8240fa9f-57a7-4c1d-9c9f-6f85eae85831-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "cinder-8240fa9f-57a7-4c1d-9c9f-6f85eae85831-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "cinder-quobyte-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "cinder-quobyte-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[af482af8-17b8-4c11-8084-dad2f87e3bd0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:47:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:14 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 Jul 09 02:47:14 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:15 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" returned: 0 in 0.968s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:15 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831 Jul 09 02:47:15 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:16 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "cinder-quobyte-8240fa9f-57a7-4c1d-9c9f-6f85eae85831" released by "delete_volume" :: held 1.780s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Created reservations ['9c106162-665d-434b-bf1d-a9ed94ee295d', 'de7b8b01-91ae-4622-832c-f04025c3fa98', 'da9c23c0-6091-44b9-8709-c76080fed4ed', '09d514bb-68a3-485b-96ed-eef7c99e0c69'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:16 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:47:16 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:17 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.891s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:17 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:47:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Deleted volume successfully. Jul 09 02:47:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7db894af-f8fe-425d-92c3-ab296c15d8b5 tempest-ServerActionsTestOtherA-1476504921 None] Lock "cinder-8240fa9f-57a7-4c1d-9c9f-6f85eae85831-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:47:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362ff5b-99db-46ec-82ec-fddc89d1ff8c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:47:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:18 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 Jul 09 02:47:18 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:19 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" returned: 0 in 1.618s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.636s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1ac526d-eca4-440f-a62b-c46913f7386b', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:47:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-e7b38bfa-3bf4-4f2f-a5a5-a131401e2848 req-d1942d60-35d7-4674-85b4-87f4f14bf4ca tempest-AttachVolumeNegativeTest-1597436921 None] attachment_update completed successfully. Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Flow 'volume_create_manager' (349d736f-a098-496b-bbeb-7385e1ec9f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb32c68-a633-45b3-97e1-a260ceb07991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb32c68-a633-45b3-97e1-a260ceb07991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-751529256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07818daa-1dc0-42ac-94e4-b3e2be9c48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6439524d4143c0b1a956083512b20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:47:26Z,use_quota=True,user_id='b22bc50d6f354f15af548885d6252b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f860e5-b16a-472d-9ab9-82a2f20953f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f860e5-b16a-472d-9ab9-82a2f20953f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ec00f-5723-4edd-9cea-e619ff326b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ec00f-5723-4edd-9cea-e619ff326b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07818daa-1dc0-42ac-94e4-b3e2be9c48c6', 'volume_name': 'volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2e1f5-c0de-46e6-a40f-52522503edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2e1f5-c0de-46e6-a40f-52522503edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12378ebc-9468-4209-990b-5e3e3a6b6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:26 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Volume 07818daa-1dc0-42ac-94e4-b3e2be9c48c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6', 'volume_size': 1} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-751529256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07818daa-1dc0-42ac-94e4-b3e2be9c48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6439524d4143c0b1a956083512b20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:47:26Z,use_quota=True,user_id='b22bc50d6f354f15af548885d6252b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Creating volume 07818daa-1dc0-42ac-94e4-b3e2be9c48c6 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:47:26 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:47:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:26 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 1073741824 Jul 09 02:47:26 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:27 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 1073741824" returned: 0 in 1.429s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:27 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 Jul 09 02:47:27 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:27 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:47:28 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:28 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" returned: 0 in 1.150s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] <== create_volume: return (2664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12378ebc-9468-4209-990b-5e3e3a6b6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ce010b-d7b7-4588-896e-f9b2221eddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:47:28 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Volume volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 (07818daa-1dc0-42ac-94e4-b3e2be9c48c6): created successfully Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ce010b-d7b7-4588-896e-f9b2221eddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:47:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Flow 'volume_create_manager' (349d736f-a098-496b-bbeb-7385e1ec9f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:47:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-49ed5404-feb4-4d65-af2b-340f53f05dad tempest-DeleteServersTestJSON-1992010453 None] Created volume successfully. Jul 09 02:47:29 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.361s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:47:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:47:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:47:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:47:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1b05f-f9fb-4dd6-842c-05ba3033e9cf]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:47:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:32 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 Jul 09 02:47:32 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:34 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" returned: 0 in 1.953s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.976s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '685bacf7-3e49-41cf-85c9-9ab25c300b2c', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:47:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-fe2b27c7-492a-43b9-9037-06226ce1fe39 req-efcb745e-bb13-48e9-a83d-3f4ff221b89c tempest-DeleteServersTestJSON-1992010453 None] attachment_update completed successfully. Jul 09 02:47:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=22,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:47:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=18,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:47:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-0d817fe4-8638-4004-9396-3df0d3899054 req-068a621a-9c8c-44cc-8903-2f0eee78221b tempest-DeleteServersTestJSON-1992010453 None] Terminate volume connection completed successfully. Jul 09 02:47:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-0d817fe4-8638-4004-9396-3df0d3899054 req-068a621a-9c8c-44cc-8903-2f0eee78221b tempest-DeleteServersTestJSON-1992010453 None] Deleting attachment 685bacf7-3e49-41cf-85c9-9ab25c300b2c. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "cinder-07818daa-1dc0-42ac-94e4-b3e2be9c48c6-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "cinder-07818daa-1dc0-42ac-94e4-b3e2be9c48c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "cinder-quobyte-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "cinder-quobyte-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfaa1fb-43f3-459f-9bff-0aa57b6db47e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:47:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:49 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 Jul 09 02:47:49 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:51 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" returned: 0 in 1.257s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:51 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6 Jul 09 02:47:51 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:51 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" returned: 0 in 0.766s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "cinder-quobyte-07818daa-1dc0-42ac-94e4-b3e2be9c48c6" released by "delete_volume" :: held 2.106s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:47:51 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Created reservations ['9b43d5ad-e278-4ea0-a6eb-e0319e03f93a', 'dfd7468f-9594-4d09-bf97-67eb6cef4e8e', 'b4de8042-ea4e-463f-acdc-30ea68a13e33', '16d7c67b-5c6b-402f-bc3a-8983a5118263'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:47:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:47:52 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:47:52 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:47:53 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Jul 09 02:47:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.127s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:47:53 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:47:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Deleted volume successfully. Jul 09 02:47:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39763606-04a3-429c-a92f-f6e7fad8810f tempest-DeleteServersTestJSON-1992010453 None] Lock "cinder-07818daa-1dc0-42ac-94e4-b3e2be9c48c6-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:48:01 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (15be9b75-bb87-44bc-8066-11b3893308fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b547c3a2-a89b-4851-8ec5-f358505be008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b547c3a2-a89b-4851-8ec5-f358505be008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1298749196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7d4b19-59a0-4adb-8a67-71e19bc8a334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:02Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53640c40-8eb8-465b-9653-b2e699ce0056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53640c40-8eb8-465b-9653-b2e699ce0056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09eb78-c10c-4d4d-967d-22e660d398e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09eb78-c10c-4d4d-967d-22e660d398e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7d4b19-59a0-4adb-8a67-71e19bc8a334', 'volume_name': 'volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbba0c8-9a72-4f82-a3c2-a6bb3a267c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbba0c8-9a72-4f82-a3c2-a6bb3a267c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75b0bed-6caf-419c-9229-82a0480f6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:02 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Volume 6a7d4b19-59a0-4adb-8a67-71e19bc8a334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334', 'volume_size': 1} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1298749196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7d4b19-59a0-4adb-8a67-71e19bc8a334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:02Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Creating volume 6a7d4b19-59a0-4adb-8a67-71e19bc8a334 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:48:02 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:48:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:02 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 1073741824 Jul 09 02:48:02 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:03 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 1073741824" returned: 0 in 0.863s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:03 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 Jul 09 02:48:03 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:04 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" returned: 0 in 0.698s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75b0bed-6caf-419c-9229-82a0480f6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0d8aa-7773-4321-8c31-3c2d1514a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:04 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Volume volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 (6a7d4b19-59a0-4adb-8a67-71e19bc8a334): created successfully Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0d8aa-7773-4321-8c31-3c2d1514a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (15be9b75-bb87-44bc-8066-11b3893308fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2360d715-5c9d-43ac-bea3-ef9dd07a9b47 tempest-AttachVolumeTestJSON-753684111 None] Created volume successfully. Jul 09 02:48:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb278fa-6e78-4a5d-9ecd-21ef0cec62dc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:48:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:07 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 Jul 09 02:48:07 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:08 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" returned: 0 in 1.051s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a99074a4-a5ea-4585-a3e8-af837aedb6ed', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:48:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-082b875e-20a1-4215-b002-6d9051e8b71e req-e56e4cf2-0d8e-4aeb-b0a6-a52f945b7880 tempest-AttachVolumeTestJSON-753684111 None] attachment_update completed successfully. Jul 09 02:48:18 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:48:18 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:27 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:48:28 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-295fc1bc-643c-4079-8855-00c5eb46755b req-8e869879-7137-49be-a2ce-373d0a08b3b6 tempest-AttachVolumeNegativeTest-1597436921 None] Terminate volume connection completed successfully. Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-295fc1bc-643c-4079-8855-00c5eb46755b req-8e869879-7137-49be-a2ce-373d0a08b3b6 tempest-AttachVolumeNegativeTest-1597436921 None] Deleting attachment c1ac526d-eca4-440f-a62b-c46913f7386b. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:48:28 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.014s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:48:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Flow 'volume_create_manager' (2fb18d17-23c2-4c6b-9680-acca6d562241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880e98eb-2d4c-4cdc-9619-b54afbc135ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880e98eb-2d4c-4cdc-9619-b54afbc135ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-76314454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecb26e2-5c10-4b75-b281-9ca8aae5f810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb29f416c3141d0a041395d81b1fe6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:38Z,use_quota=True,user_id='59adc22716d24c35b2c94c05583dae31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5713df72-2c2f-4bcd-97ee-71e2fecf0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5713df72-2c2f-4bcd-97ee-71e2fecf0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b52b1b-76c3-4b4f-9bb6-c06941daf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b52b1b-76c3-4b4f-9bb6-c06941daf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecb26e2-5c10-4b75-b281-9ca8aae5f810', 'volume_name': 'volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cf95a3-2c39-4c9c-93c5-020916eaac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cf95a3-2c39-4c9c-93c5-020916eaac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fafd75b-9c6b-4961-8d3b-68a9a1383d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Volume 2ecb26e2-5c10-4b75-b281-9ca8aae5f810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810', 'volume_size': 1} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-76314454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecb26e2-5c10-4b75-b281-9ca8aae5f810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb29f416c3141d0a041395d81b1fe6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:38Z,use_quota=True,user_id='59adc22716d24c35b2c94c05583dae31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Creating volume 2ecb26e2-5c10-4b75-b281-9ca8aae5f810 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:48:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:48:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:38 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 1073741824 Jul 09 02:48:38 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:40 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 1073741824" returned: 0 in 1.579s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:40 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 Jul 09 02:48:40 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:41 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" returned: 0 in 1.212s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.874s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fafd75b-9c6b-4961-8d3b-68a9a1383d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5267c9-8c1d-4926-b34f-4dbf7cc49a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Volume volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 (2ecb26e2-5c10-4b75-b281-9ca8aae5f810): created successfully Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5267c9-8c1d-4926-b34f-4dbf7cc49a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Flow 'volume_create_manager' (2fb18d17-23c2-4c6b-9680-acca6d562241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b3c0d47c-5385-480a-ba1f-f4664942eb1e tempest-AttachVolumeShelveTestJSON-888857059 None] Created volume successfully. Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Flow 'volume_create_manager' (be2508cc-0969-4c4c-bd32-83977cb4e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54911558-5981-43b8-81f1-30ce460f7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54911558-5981-43b8-81f1-30ce460f7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1018445438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230ce1d-7a0c-4514-837b-b000226917ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59750ec03ea48a589afc1f0a8c56bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:51Z,use_quota=True,user_id='179da306da814e4e876f924ad8a7afaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107230f9-0601-4574-8c6d-d9ae9211561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107230f9-0601-4574-8c6d-d9ae9211561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4f5280-5373-4d9c-9720-0609b31d1d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4f5280-5373-4d9c-9720-0609b31d1d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4230ce1d-7a0c-4514-837b-b000226917ca', 'volume_name': 'volume-4230ce1d-7a0c-4514-837b-b000226917ca', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f601acd-d841-43c7-86ff-5e5ea0724844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f601acd-d841-43c7-86ff-5e5ea0724844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65373a8-1747-4545-9f94-6b47fe1ce9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Volume 4230ce1d-7a0c-4514-837b-b000226917ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4230ce1d-7a0c-4514-837b-b000226917ca', 'volume_size': 1} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1018445438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4230ce1d-7a0c-4514-837b-b000226917ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59750ec03ea48a589afc1f0a8c56bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:48:51Z,use_quota=True,user_id='179da306da814e4e876f924ad8a7afaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Creating volume 4230ce1d-7a0c-4514-837b-b000226917ca {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:48:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:48:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:50 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca 1073741824 Jul 09 02:48:50 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:51 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca 1073741824" returned: 0 in 1.147s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:48:52 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca Jul 09 02:48:52 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:48:53 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca" returned: 0 in 1.088s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65373a8-1747-4545-9f94-6b47fe1ce9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4230ce1d-7a0c-4514-837b-b000226917ca', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e125db-ffc4-4bca-888e-e5a20040fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:48:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Volume volume-4230ce1d-7a0c-4514-837b-b000226917ca (4230ce1d-7a0c-4514-837b-b000226917ca): created successfully Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e125db-ffc4-4bca-888e-e5a20040fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:48:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Flow 'volume_create_manager' (be2508cc-0969-4c4c-bd32-83977cb4e22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:48:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0a3cca45-7694-475d-916e-3ae79162913b tempest-ServerRescueNegativeTestJSON-1029729725 None] Created volume successfully. Jul 09 02:49:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-384e1207-7a5e-40f4-80ba-929a6ef1f52b req-7c97e2b8-fd66-4734-91c8-cae1b9503949 tempest-AttachVolumeShelveTestJSON-888857059 None] No connector for attachment 97effe51-1ca4-4d79-b311-a65cf666e451; skipping storage backend terminate_connection call. {{(pid=87156) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 02:49:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-384e1207-7a5e-40f4-80ba-929a6ef1f52b req-7c97e2b8-fd66-4734-91c8-cae1b9503949 tempest-AttachVolumeShelveTestJSON-888857059 None] Deleting attachment 97effe51-1ca4-4d79-b311-a65cf666e451. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:49:03 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:49:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-f483b8e5-f431-4b10-9063-8dee2e74eb57 req-163b64f8-4fed-4278-8aad-932f1d58f1b5 tempest-AttachVolumeTestJSON-753684111 None] Terminate volume connection completed successfully. Jul 09 02:49:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-f483b8e5-f431-4b10-9063-8dee2e74eb57 req-163b64f8-4fed-4278-8aad-932f1d58f1b5 tempest-AttachVolumeTestJSON-753684111 None] Deleting attachment a99074a4-a5ea-4585-a3e8-af837aedb6ed. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Acquiring lock "cinder-4230ce1d-7a0c-4514-837b-b000226917ca-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "cinder-4230ce1d-7a0c-4514-837b-b000226917ca-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Acquiring lock "cinder-quobyte-4230ce1d-7a0c-4514-837b-b000226917ca" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "cinder-quobyte-4230ce1d-7a0c-4514-837b-b000226917ca" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81237e1-fa32-4704-a2d2-da3c9fd3a17c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:49:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:13 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca Jul 09 02:49:13 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:15 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca" returned: 0 in 1.981s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:15 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca Jul 09 02:49:15 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:16 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4230ce1d-7a0c-4514-837b-b000226917ca" returned: 0 in 1.146s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "cinder-quobyte-4230ce1d-7a0c-4514-837b-b000226917ca" released by "delete_volume" :: held 3.184s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Created reservations ['c2968a4a-ddfa-4e05-8bb4-03744ed33d66', 'eae9ee33-2d65-4eeb-842f-17493e97cfa4', '0e45013d-7da6-4a7c-b180-b51ce7c06e2b', 'b1eaef8b-7f03-42e6-be1c-d0ab12cb2053'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:16 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:49:16 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:18 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.284s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:18 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:49:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Deleted volume successfully. Jul 09 02:49:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cc69b19e-8b4e-4ee5-bea3-a4e935e3e6a1 tempest-ServerRescueNegativeTestJSON-1029729725 None] Lock "cinder-4230ce1d-7a0c-4514-837b-b000226917ca-delete_volume" released by "delete_volume" :: held 4.955s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:49:26 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:28 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:49:28 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:28 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:49:29 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.880s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:49:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:49:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:49:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (4e420103-3ffb-4f15-a233-26cc2454b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e548e-0e3f-4fbc-b636-c1563a47f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e548e-0e3f-4fbc-b636-c1563a47f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1307565158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607cbe6-7504-43ae-b65b-789764889a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:49:31Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec0079a-56a2-4921-94ff-d59c720bbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec0079a-56a2-4921-94ff-d59c720bbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e53d174-0c22-4806-9c74-ef74821538f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e53d174-0c22-4806-9c74-ef74821538f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c607cbe6-7504-43ae-b65b-789764889a7f', 'volume_name': 'volume-c607cbe6-7504-43ae-b65b-789764889a7f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdacf50-e0ae-4655-a19b-37994f36c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdacf50-e0ae-4655-a19b-37994f36c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0306670e-5164-469d-86b4-6baceb90e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Volume c607cbe6-7504-43ae-b65b-789764889a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c607cbe6-7504-43ae-b65b-789764889a7f', 'volume_size': 1} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1307565158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607cbe6-7504-43ae-b65b-789764889a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:49:31Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Creating volume c607cbe6-7504-43ae-b65b-789764889a7f {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:49:31 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:49:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:31 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f 1073741824 Jul 09 02:49:31 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:32 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f 1073741824" returned: 0 in 1.063s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:32 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f Jul 09 02:49:32 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:33 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f" returned: 0 in 0.720s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0306670e-5164-469d-86b4-6baceb90e03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c607cbe6-7504-43ae-b65b-789764889a7f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a299cc5-8c87-4790-ad0b-1fc43f84f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:33 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Volume volume-c607cbe6-7504-43ae-b65b-789764889a7f (c607cbe6-7504-43ae-b65b-789764889a7f): created successfully Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a299cc5-8c87-4790-ad0b-1fc43f84f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (4e420103-3ffb-4f15-a233-26cc2454b527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:49:33 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-76ad8cf3-657f-4bab-b3cd-87982eec9306 tempest-AttachVolumeNegativeTest-1597436921 None] Created volume successfully. Jul 09 02:49:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9683b79d-3a2d-4ad5-8222-74d46ac3e14c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:49:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:38 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f Jul 09 02:49:38 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:39 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f" returned: 0 in 1.203s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.237s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-c607cbe6-7504-43ae-b65b-789764889a7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8f1697c-ec37-4b94-8f4e-05b6c8042940', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:49:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-b08704f5-f4e6-41e9-a49e-e6d7459cf139 req-66a912c3-6cd8-41f6-bff7-f0e66ad442c5 tempest-AttachVolumeNegativeTest-1597436921 None] attachment_update completed successfully. Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Flow 'volume_create_manager' (bde86eb5-0f8c-4284-82f1-16ba86311099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b676f71-72c5-44ea-aa62-27266ea90686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b676f71-72c5-44ea-aa62-27266ea90686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551164935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e8e3a-98c8-4853-adba-a3d4c9d5d255,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8eb56da5938345a4904f12f1b5b47c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:49:43Z,use_quota=True,user_id='282b891022654c8fa089c7c11c5e1d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea166cb5-9d36-415f-9593-c8e0041e7168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea166cb5-9d36-415f-9593-c8e0041e7168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee825b4-2116-47ba-a7b1-d84285770a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee825b4-2116-47ba-a7b1-d84285770a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4e8e3a-98c8-4853-adba-a3d4c9d5d255', 'volume_name': 'volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f4756-2e3a-4521-b4a9-06f8e88d41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f4756-2e3a-4521-b4a9-06f8e88d41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353f5ea2-0a71-4a3a-a8b9-2e54cc6ad1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:42 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Volume 2f4e8e3a-98c8-4853-adba-a3d4c9d5d255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255', 'volume_size': 1} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551164935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e8e3a-98c8-4853-adba-a3d4c9d5d255,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8eb56da5938345a4904f12f1b5b47c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:49:43Z,use_quota=True,user_id='282b891022654c8fa089c7c11c5e1d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Creating volume 2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:49:42 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:49:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:42 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 1073741824 Jul 09 02:49:42 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:43 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 1073741824" returned: 0 in 0.856s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:43 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 Jul 09 02:49:43 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:44 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353f5ea2-0a71-4a3a-a8b9-2e54cc6ad1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95319bf-7ae1-4822-a165-ff2c378da9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:49:44 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Volume volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 (2f4e8e3a-98c8-4853-adba-a3d4c9d5d255): created successfully Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95319bf-7ae1-4822-a165-ff2c378da9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Flow 'volume_create_manager' (bde86eb5-0f8c-4284-82f1-16ba86311099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:49:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-acf66b2a-e061-43d4-b311-af12b240be91 req-1a84bfed-4026-4275-a320-dbeeb387a696 tempest-VolumesGetTestJSON-1860536049 None] Created volume successfully. Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Acquiring lock "cinder-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "cinder-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Acquiring lock "cinder-quobyte-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:49:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "cinder-quobyte-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:49:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac24765-f6e2-42b9-92dc-c3366f2cd005]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:49:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:45 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 Jul 09 02:49:45 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-de21fa2a-a784-4024-8c90-92581350e074 req-aac5b9c0-c3aa-433b-b5ed-30707c1671cf tempest-AttachVolumeNegativeTest-1597436921 None] Terminate volume connection completed successfully. Jul 09 02:49:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-de21fa2a-a784-4024-8c90-92581350e074 req-aac5b9c0-c3aa-433b-b5ed-30707c1671cf tempest-AttachVolumeNegativeTest-1597436921 None] Deleting attachment d8f1697c-ec37-4b94-8f4e-05b6c8042940. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:49:45 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" returned: 0 in 0.848s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:45 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255 Jul 09 02:49:45 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:46 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "cinder-quobyte-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255" released by "delete_volume" :: held 1.606s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG cinder.quota [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Created reservations ['c5c2a8ab-8b45-4497-9362-659b25bd0670', '4025b544-ab08-4ff2-bd1e-9a00dcaae600', '7d0b4e06-7524-47fb-80e3-1581d4d5b151', '381b1573-0d8a-40cd-8e77-cd63eba9f376'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:49:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:49:46 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:49:46 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:49:47 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 09 02:49:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.689s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:49:47 devstack cinder-volume[87156]: DEBUG cinder.manager [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:49:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Deleted volume successfully. Jul 09 02:49:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-4f2b99e4-0bde-4d40-8f30-530c5f2d049e req-1f33b411-f96a-48b6-9ec3-c35b76ec3130 tempest-VolumesGetTestJSON-1860536049 None] Lock "cinder-2f4e8e3a-98c8-4853-adba-a3d4c9d5d255-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:49:56 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:49:57 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Acquiring lock "cinder-2ecb26e2-5c10-4b75-b281-9ca8aae5f810-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "cinder-2ecb26e2-5c10-4b75-b281-9ca8aae5f810-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Acquiring lock "cinder-quobyte-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "cinder-quobyte-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[739951ce-0c4a-4fbd-a1ee-b1a861ce0b62]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:03 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 Jul 09 02:50:03 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:04 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:04 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810 Jul 09 02:50:04 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:05 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "cinder-quobyte-2ecb26e2-5c10-4b75-b281-9ca8aae5f810" released by "delete_volume" :: held 1.684s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Created reservations ['94c6f020-aed4-4c9e-a8f4-a97dfa4e4f8f', 'ef3887ef-d259-4f9d-9bba-eeb1da94aa36', 'd47fe3ff-391a-4bc8-b04f-3d74ae70cc4f', '220e05b2-f924-4939-8c30-1897837927d9'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:05 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:50:05 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:06 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.828s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:06 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:50:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Deleted volume successfully. Jul 09 02:50:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c10e5033-ce99-45bb-8379-af158856d3d3 tempest-AttachVolumeShelveTestJSON-888857059 None] Lock "cinder-2ecb26e2-5c10-4b75-b281-9ca8aae5f810-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Flow 'volume_create_manager' (e470bf08-93e2-4721-9e2d-b7a510d2d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd4da0c-2109-4f7c-b197-3b629b6121bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd4da0c-2109-4f7c-b197-3b629b6121bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1865049526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107bbac5-fe58-4d3b-a193-608ef7fb8210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711764c3512c4d9ea9828a4c9a92a3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:07Z,use_quota=True,user_id='25569b8be0724c7f86bf00fa16778efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65cd5c2-d815-49fc-be6f-b00389acb900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65cd5c2-d815-49fc-be6f-b00389acb900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133bf2af-c09f-426b-97a1-65dac3003b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133bf2af-c09f-426b-97a1-65dac3003b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107bbac5-fe58-4d3b-a193-608ef7fb8210', 'volume_name': 'volume-107bbac5-fe58-4d3b-a193-608ef7fb8210', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0fa53d-6f13-4cd4-a552-c03b50f499d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0fa53d-6f13-4cd4-a552-c03b50f499d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e906d456-5559-46b4-a2a8-fa968574373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:07 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Volume 107bbac5-fe58-4d3b-a193-608ef7fb8210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107bbac5-fe58-4d3b-a193-608ef7fb8210', 'volume_size': 1} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1865049526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107bbac5-fe58-4d3b-a193-608ef7fb8210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711764c3512c4d9ea9828a4c9a92a3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:07Z,use_quota=True,user_id='25569b8be0724c7f86bf00fa16778efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Creating volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:07 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:07 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 1073741824 Jul 09 02:50:07 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:08 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 1073741824" returned: 0 in 1.096s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:08 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 Jul 09 02:50:08 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:09 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210" returned: 0 in 0.869s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e906d456-5559-46b4-a2a8-fa968574373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107bbac5-fe58-4d3b-a193-608ef7fb8210', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf9bc39-7783-4b8a-b834-2b774573f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:09 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Volume volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 (107bbac5-fe58-4d3b-a193-608ef7fb8210): created successfully Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf9bc39-7783-4b8a-b834-2b774573f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Flow 'volume_create_manager' (e470bf08-93e2-4721-9e2d-b7a510d2d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6015fa2f-acfd-45e3-8582-e0dfbae66a41 tempest-SnapshotsActionsTest-161080406 None] Created volume successfully. Jul 09 02:50:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Creating offline snapshot 255650bd-ff71-4867-b375-07b2264565f3 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:50:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[59290c10-244e-4559-ac97-254f6db181e9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:11 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 Jul 09 02:50:11 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:11 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210" returned: 0 in 1.086s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:11 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 1G Jul 09 02:50:11 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:13 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 1G" returned: 0 in 1.078s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:13 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:13 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:13 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.751s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:13 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 is being set with open permissions: ugo+rw Jul 09 02:50:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:13 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:13 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:14 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.916s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:14 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info Jul 09 02:50:14 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:15 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info" returned: 0 in 0.926s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:15 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info is being set with open permissions: ugo+rw Jul 09 02:50:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:15 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info Jul 09 02:50:15 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:16 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.info" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.743s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ce2865e3-a793-45ce-b7d1-3aa09bb68661 tempest-SnapshotsActionsTest-161080406 None] Create snapshot completed successfully Jul 09 02:50:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Creating offline snapshot f259431f-03f6-4638-8005-f9958aa9b679 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:50:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0677080-1815-4882-82e5-82b3871d86e1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:19 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:19 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:20 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 1.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:20 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 1G Jul 09 02:50:20 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:22 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 1G" returned: 0 in 1.876s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:22 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 Jul 09 02:50:22 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:24 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679" returned: 0 in 1.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:24 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 is being set with open permissions: ugo+rw Jul 09 02:50:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:24 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 Jul 09 02:50:24 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:25 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679" returned: 0 in 0.993s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.563s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6dec4c80-8645-40ca-ad7f-a4ae61b93958 tempest-SnapshotsActionsTest-161080406 None] Create snapshot completed successfully Jul 09 02:50:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa2d8dc5-f146-48f8-8424-46adce538877 tempest-GroupsTest-1767431521 None] Group tempest-Group1-567798807: creating Jul 09 02:50:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa2d8dc5-f146-48f8-8424-46adce538877 tempest-GroupsTest-1767431521 None] Group tempest-Group1-567798807: created successfully Jul 09 02:50:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa2d8dc5-f146-48f8-8424-46adce538877 tempest-GroupsTest-1767431521 None] Create group completed successfully. Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-f259431f-03f6-4638-8005-f9958aa9b679-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-f259431f-03f6-4638-8005-f9958aa9b679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-f259431f-03f6-4638-8005-f9958aa9b679" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-f259431f-03f6-4638-8005-f9958aa9b679" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Deleting offline snapshot f259431f-03f6-4638-8005-f9958aa9b679 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] snapshot_file for this snap is: volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba16f9-d3e5-4529-921c-e2bf0abe0c13]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3bef5ba8-8fbd-4ac6-b53a-64d3af256107 tempest-GroupsTest-1767431521 None] Group tempest-Group2-1788586126: creating Jul 09 02:50:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3bef5ba8-8fbd-4ac6-b53a-64d3af256107 tempest-GroupsTest-1767431521 None] Group tempest-Group2-1788586126: created successfully Jul 09 02:50:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3bef5ba8-8fbd-4ac6-b53a-64d3af256107 tempest-GroupsTest-1767431521 None] Create group completed successfully. Jul 09 02:50:26 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 Jul 09 02:50:26 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:27 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679" returned: 0 in 0.877s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05ac64-61f1-4e08-a10e-295f4af4589d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:27 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:27 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:27 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:50:27 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:28 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:28 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 Jul 09 02:50:28 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (b8788230-a8f3-4a80-a3e3-995ee732bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05602249-4ab2-4f9d-8bbe-4ae184e3f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05602249-4ab2-4f9d-8bbe-4ae184e3f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774492402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a81d688-dd79-4fa3-9284-9340679637db,host='devstack@QuobyteHD#QuobyteHD',id=b2f80ab8-3bf7-4ffe-81ff-aec669e1d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:29Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624ebc08-eb6f-4b48-9cbe-cf584942f002),volume_type_id=624ebc08-eb6f-4b48-9cbe-cf584942f002)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517a0e70-1dd4-4ae2-af6f-2e924e389ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517a0e70-1dd4-4ae2-af6f-2e924e389ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a742c76-6078-4811-8cd2-4b0d5c7e6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a742c76-6078-4811-8cd2-4b0d5c7e6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f80ab8-3bf7-4ffe-81ff-aec669e1d756', 'volume_name': 'volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bd53da-6c8a-48a1-8b8f-2e7d356deee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bd53da-6c8a-48a1-8b8f-2e7d356deee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3012cdd-773a-489d-9c74-f1b3ba3263b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Volume b2f80ab8-3bf7-4ffe-81ff-aec669e1d756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756', 'volume_size': 1} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a81d688-dd79-4fa3-9284-9340679637db,created_at=2026-07-09T00:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774492402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a81d688-dd79-4fa3-9284-9340679637db,host='devstack@QuobyteHD#QuobyteHD',id=b2f80ab8-3bf7-4ffe-81ff-aec669e1d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:29Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624ebc08-eb6f-4b48-9cbe-cf584942f002),volume_type_id=624ebc08-eb6f-4b48-9cbe-cf584942f002)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Creating volume b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:29 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:29 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 1073741824 Jul 09 02:50:29 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:29 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.510s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:50:29 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679" returned: 0 in 1.449s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:29 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679 Jul 09 02:50:29 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:30 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 1073741824" returned: 0 in 1.015s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:30 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 Jul 09 02:50:30 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:30 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.f259431f-03f6-4638-8005-f9958aa9b679" returned: 0 in 1.017s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-f259431f-03f6-4638-8005-f9958aa9b679" released by "_delete_snapshot" :: held 4.386s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_snapshot" :: held 4.428s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:30 devstack cinder-volume[87156]: WARNING cinder.quota [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Created reservations ['0617bad2-6c0b-4e5f-8ad3-d244fb9e272f', '443dd03f-1ba8-418c-91ce-59cad422705e', '541a7a9d-ad3d-4fb4-820b-825b7d3307ca', '1d8d5f6c-6270-4cb1-a2e9-153068c44810'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Delete snapshot completed successfully. Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-433121fd-dda7-410b-9ce8-c4a4c2e51064 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-f259431f-03f6-4638-8005-f9958aa9b679-delete_snapshot" released by "delete_snapshot" :: held 4.598s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:31 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" returned: 0 in 0.767s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3012cdd-773a-489d-9c74-f1b3ba3263b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68502330-7af1-4084-8a9b-ef9da56073c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Volume volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 (b2f80ab8-3bf7-4ffe-81ff-aec669e1d756): created successfully Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68502330-7af1-4084-8a9b-ef9da56073c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (b8788230-a8f3-4a80-a3e3-995ee732bea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1ff2ef9e-8deb-4189-bbaa-6968475ec8e7 tempest-GroupsTest-1767431521 None] Created volume successfully. Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Creating offline snapshot 8c865476-5aa1-492f-b995-30b18cbb358a of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7697193c-4cf1-43e2-b02e-542d1386a6bc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Acquiring lock "cinder-quobyte-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" acquired by "delete_volume" :: waited 0.051s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2177bb-7d46-4a74-a62b-88fedb7144ae]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:32 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:32 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:32 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 Jul 09 02:50:32 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:33 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.812s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:33 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a 1G Jul 09 02:50:33 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:33 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" returned: 0 in 0.852s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:33 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756 Jul 09 02:50:33 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:34 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:34 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a 1G" returned: 0 in 0.876s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" returned: 0 in 0.733s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:34 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a Jul 09 02:50:34 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-b2f80ab8-3bf7-4ffe-81ff-aec669e1d756" released by "delete_volume" :: held 1.635s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Created reservations ['3437ec75-013b-451d-9d99-cb4a86746f42'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:34 devstack cinder-volume[87156]: WARNING cinder.quota [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1811877118 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1811877118, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:50:34 devstack cinder-volume[87156]: WARNING cinder.quota [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1811877118 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1811877118, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Created reservations ['54c5dc91-b64c-4095-948a-e4ddcdf9d196', '7412ddca-f59c-40dd-9634-6b9fe271456a', '11b1c8e5-0965-4e96-847a-9651fc1d0119', '7dc76ec3-1f77-40a2-9582-e92b5e3c41ad'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:34 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:50:34 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:34 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a" returned: 0 in 0.730s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:34 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a is being set with open permissions: ugo+rw Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:34 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a Jul 09 02:50:34 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:34 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:50:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2722ba43-1ff1-4e21-b75f-af8612369824 tempest-GroupsTest-1767431521 None] Delete group completed successfully. Jul 09 02:50:34 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Created reservations ['7f6aa187-c902-4dfa-a300-5d2fb0925ba8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:35 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:50:35 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:35 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a26dc597-cbc4-4e35-bc82-3809020256bb tempest-SnapshotsActionsTest-161080406 None] Create snapshot completed successfully Jul 09 02:50:35 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.705s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:35 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:50:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c4c191b7-a0c1-41a0-9fdb-ae2141bda4c1 tempest-GroupsTest-1767431521 None] Delete group completed successfully. Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-8c865476-5aa1-492f-b995-30b18cbb358a-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-8c865476-5aa1-492f-b995-30b18cbb358a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-8c865476-5aa1-492f-b995-30b18cbb358a" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-8c865476-5aa1-492f-b995-30b18cbb358a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Deleting offline snapshot 8c865476-5aa1-492f-b995-30b18cbb358a of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] snapshot_file for this snap is: volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:50:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-985eba92-5138-4e9c-9f5e-f2fbb5dbd6cc tempest-GroupsTest-1767431521 None] Group tempest-GroupsTest-Group-685740331: creating Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f8aabc-9d4c-42ac-9083-1b5650f4ee83]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-985eba92-5138-4e9c-9f5e-f2fbb5dbd6cc tempest-GroupsTest-1767431521 None] Group tempest-GroupsTest-Group-685740331: created successfully Jul 09 02:50:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-985eba92-5138-4e9c-9f5e-f2fbb5dbd6cc tempest-GroupsTest-1767431521 None] Create group completed successfully. Jul 09 02:50:36 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a Jul 09 02:50:36 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:37 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a" returned: 0 in 0.762s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097bfa8-1796-4cad-850a-e9880cf0faa1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:37 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:37 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:38 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (7ce187cb-50a8-4e7d-8c5a-67c653ab0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e6c55-95f4-4460-b408-8f7f0ade4b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.922s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e6c55-95f4-4460-b408-8f7f0ade4b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476633238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=583360ff-786b-4525-8b26-093b5acf31aa,host='devstack@QuobyteHD#QuobyteHD',id=482692b9-bda4-4440-9fc9-e0f0cc20328d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:38Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fefdfe-8e21-4f93-a198-7ffd541d0c4b),volume_type_id=42fefdfe-8e21-4f93-a198-7ffd541d0c4b)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789f6d05-7088-4216-9973-d7ab0ac69208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:38 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a Jul 09 02:50:38 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789f6d05-7088-4216-9973-d7ab0ac69208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429cbd59-6a58-48a9-8e9b-e06348bf02fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429cbd59-6a58-48a9-8e9b-e06348bf02fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482692b9-bda4-4440-9fc9-e0f0cc20328d', 'volume_name': 'volume-482692b9-bda4-4440-9fc9-e0f0cc20328d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47477b19-74a3-4bc3-94bf-75af2c06cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47477b19-74a3-4bc3-94bf-75af2c06cd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d8310c-e051-4537-8fa8-15c13fbd33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Volume 482692b9-bda4-4440-9fc9-e0f0cc20328d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482692b9-bda4-4440-9fc9-e0f0cc20328d', 'volume_size': 1} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=583360ff-786b-4525-8b26-093b5acf31aa,created_at=2026-07-09T00:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476633238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=583360ff-786b-4525-8b26-093b5acf31aa,host='devstack@QuobyteHD#QuobyteHD',id=482692b9-bda4-4440-9fc9-e0f0cc20328d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:38Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fefdfe-8e21-4f93-a198-7ffd541d0c4b),volume_type_id=42fefdfe-8e21-4f93-a198-7ffd541d0c4b)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Creating volume 482692b9-bda4-4440-9fc9-e0f0cc20328d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:38 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d 1073741824 Jul 09 02:50:38 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:39 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a" returned: 0 in 0.799s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:39 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a Jul 09 02:50:39 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:39 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d 1073741824" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:39 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d Jul 09 02:50:39 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:39 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.8c865476-5aa1-492f-b995-30b18cbb358a" returned: 0 in 0.705s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-8c865476-5aa1-492f-b995-30b18cbb358a" released by "_delete_snapshot" :: held 3.286s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_snapshot" :: held 3.323s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Created reservations ['50179874-2636-4756-b510-526c1c835f6e', '87f1e730-ecfa-4367-a1ec-0202eb161f06', 'b1467ae5-7c6e-455b-b26e-a94d7ef31d96', '8b3ef9bb-ffca-4e4b-a6fe-3b944e016447'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:40 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Delete snapshot completed successfully. Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d8310c-e051-4537-8fa8-15c13fbd33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482692b9-bda4-4440-9fc9-e0f0cc20328d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed78344-4684-4897-92c0-440a6ba4cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8e3e85d-282d-4321-b210-5480b02c20aa tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-8c865476-5aa1-492f-b995-30b18cbb358a-delete_snapshot" released by "delete_snapshot" :: held 3.560s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:40 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Volume volume-482692b9-bda4-4440-9fc9-e0f0cc20328d (482692b9-bda4-4440-9fc9-e0f0cc20328d): created successfully Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed78344-4684-4897-92c0-440a6ba4cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (7ce187cb-50a8-4e7d-8c5a-67c653ab0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f42376b8-5e1e-493d-945c-2885c4af409b tempest-GroupsTest-1767431521 None] Created volume successfully. Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Creating offline snapshot 013c5291-2766-42db-8eb3-43e449eabe28 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e530751-cb55-48ec-9804-dc2ea83efab8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:41 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:41 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (67dd8019-454d-4c91-8274-d7077763df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c4b48c-3a84-4964-a227-1b8670b932a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c4b48c-3a84-4964-a227-1b8670b932a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687188920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=583360ff-786b-4525-8b26-093b5acf31aa,host='devstack@QuobyteHD#QuobyteHD',id=b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:41Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fefdfe-8e21-4f93-a198-7ffd541d0c4b),volume_type_id=42fefdfe-8e21-4f93-a198-7ffd541d0c4b)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5213c7b6-2919-4184-99d3-ed33a86af04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5213c7b6-2919-4184-99d3-ed33a86af04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f42d6c3-9d75-42bf-8b29-706b74d86ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f42d6c3-9d75-42bf-8b29-706b74d86ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf', 'volume_name': 'volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61429f91-3b4a-40db-b270-71636a9c9d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61429f91-3b4a-40db-b270-71636a9c9d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e4cd1f-d1ce-4ea7-b170-ad69c86ce778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Volume b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf', 'volume_size': 1} Jul 09 02:50:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:42 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:42 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 1G Jul 09 02:50:42 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (e1e23b62-baa1-483e-a989-79442f11751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb9e34-a8d6-43d8-9d72-ab9daff39b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb9e34-a8d6-43d8-9d72-ab9daff39b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-200689568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a9759f-6aba-4b71-87d0-fdcc5d353a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:42Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4556bad1-6e6f-4d58-b363-8a85fb7e8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4556bad1-6e6f-4d58-b363-8a85fb7e8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e5db32-c0c5-4f23-a5af-15b0394ef74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e5db32-c0c5-4f23-a5af-15b0394ef74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a9759f-6aba-4b71-87d0-fdcc5d353a92', 'volume_name': 'volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0f8d3c-6e9f-46b5-b8e8-1b672060f436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0f8d3c-6e9f-46b5-b8e8-1b672060f436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f415da69-b02c-44a3-92a4-4f0985150c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:42 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Volume 32a9759f-6aba-4b71-87d0-fdcc5d353a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92', 'volume_size': 1} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:42 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 1G" returned: 0 in 0.803s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:42 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 Jul 09 02:50:42 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:43 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:43 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 is being set with open permissions: ugo+rw Jul 09 02:50:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:43 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 Jul 09 02:50:43 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:44 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28" returned: 0 in 0.634s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.138s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.797s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=583360ff-786b-4525-8b26-093b5acf31aa,created_at=2026-07-09T00:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687188920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=583360ff-786b-4525-8b26-093b5acf31aa,host='devstack@QuobyteHD#QuobyteHD',id=b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa3faa84eec4d6b9ec6b32f8996781e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:41Z,use_quota=True,user_id='823092b5a7f14f67a06504bce041aabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fefdfe-8e21-4f93-a198-7ffd541d0c4b),volume_type_id=42fefdfe-8e21-4f93-a198-7ffd541d0c4b)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Creating volume b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:44 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:44 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf 1073741824 Jul 09 02:50:44 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7467f3c3-137f-4de8-8153-ded365ac0f92 tempest-SnapshotsActionsTest-161080406 None] Create snapshot completed successfully Jul 09 02:50:45 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf 1073741824" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:45 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf Jul 09 02:50:45 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (24cf4eb5-4a7d-486d-be0d-24027e39d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea56964-24ef-4af3-8bdd-be0a399c068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea56964-24ef-4af3-8bdd-be0a399c068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1046414526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668332a5-962c-4c70-8f90-041033238ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:45Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475c5b01-a173-4cdc-8698-7632d950cf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475c5b01-a173-4cdc-8698-7632d950cf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3893e1e-e776-4f73-ba91-013565312c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3893e1e-e776-4f73-ba91-013565312c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668332a5-962c-4c70-8f90-041033238ce0', 'volume_name': 'volume-668332a5-962c-4c70-8f90-041033238ce0', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334275b-5d70-4b76-975e-70d64d4c4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e334275b-5d70-4b76-975e-70d64d4c4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c232f25-0ef5-48db-8ae9-aba701169273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Volume 668332a5-962c-4c70-8f90-041033238ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668332a5-962c-4c70-8f90-041033238ce0', 'volume_size': 1} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-013c5291-2766-42db-8eb3-43e449eabe28-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-013c5291-2766-42db-8eb3-43e449eabe28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-013c5291-2766-42db-8eb3-43e449eabe28" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-013c5291-2766-42db-8eb3-43e449eabe28" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Deleting offline snapshot 013c5291-2766-42db-8eb3-43e449eabe28 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] snapshot_file for this snap is: volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539e380-bdb5-4312-bec7-6a168c50aece]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:45 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 Jul 09 02:50:45 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:45 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" returned: 0 in 0.697s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.636s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-200689568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a9759f-6aba-4b71-87d0-fdcc5d353a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18697db0304a7ba1c06c1365d813d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:42Z,use_quota=True,user_id='8397d17e812546a087de09fdc5191bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Creating volume 32a9759f-6aba-4b71-87d0-fdcc5d353a92 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:45 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:45 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 1073741824 Jul 09 02:50:45 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e4cd1f-d1ce-4ea7-b170-ad69c86ce778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659f28d2-9788-4dd5-828b-879cb5f4498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Volume volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf (b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf): created successfully Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659f28d2-9788-4dd5-828b-879cb5f4498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Flow 'volume_create_manager' (67dd8019-454d-4c91-8274-d7077763df3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-57676ef2-2661-4c52-9019-7a6059045af3 tempest-GroupsTest-1767431521 None] Created volume successfully. Jul 09 02:50:46 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28" returned: 0 in 0.804s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[535246b7-530e-4e9f-9b1a-dd58373dafac]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:46 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:46 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:46 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 1073741824" returned: 0 in 0.878s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:46 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 Jul 09 02:50:46 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:47 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.807s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:47 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 Jul 09 02:50:47 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f1309f1b-24f6-4f73-b1a9-6d4048077b3c tempest-GroupsTest-1767431521 None] Update group completed successfully. Jul 09 02:50:47 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92" returned: 0 in 0.756s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1046414526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668332a5-962c-4c70-8f90-041033238ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:50:45Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Creating volume 668332a5-962c-4c70-8f90-041033238ce0 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:50:47 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f415da69-b02c-44a3-92a4-4f0985150c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:47 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 1073741824 Jul 09 02:50:47 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42c3ff-8293-4232-811c-245fc0b0c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:47 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Volume volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 (32a9759f-6aba-4b71-87d0-fdcc5d353a92): created successfully Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42c3ff-8293-4232-811c-245fc0b0c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Flow 'volume_create_manager' (e1e23b62-baa1-483e-a989-79442f11751a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a8490eb9-7171-4719-b626-9afe71451335 tempest-AttachVolumeNegativeTest-1597436921 None] Created volume successfully. Jul 09 02:50:48 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28" returned: 0 in 0.833s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:48 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28 Jul 09 02:50:48 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:48 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 1073741824" returned: 0 in 0.884s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:48 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 Jul 09 02:50:48 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:48 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.013c5291-2766-42db-8eb3-43e449eabe28" returned: 0 in 0.745s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-013c5291-2766-42db-8eb3-43e449eabe28" released by "_delete_snapshot" :: held 3.314s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_snapshot" :: held 3.336s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:48 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Created reservations ['d57058a8-2961-4d76-b2f1-db6fb1cd7a1f', '27d44cfa-1cc4-45c5-9c5d-11be767b0f11', 'ad7ab519-e638-417f-a7dd-7082a7ec957d', '5459297e-19d5-40a2-b6d0-a03ce0f4b0d9'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fe9c6b8d-fea0-4b44-a942-ecaf0886cb92 tempest-GroupsTest-1767431521 None] Update group completed successfully. Jul 09 02:50:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Delete snapshot completed successfully. Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b92e48e-f9fb-4d72-9c9f-c576a0259425 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-013c5291-2766-42db-8eb3-43e449eabe28-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:49 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0" returned: 0 in 0.750s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c232f25-0ef5-48db-8ae9-aba701169273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668332a5-962c-4c70-8f90-041033238ce0', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20a032e-e519-4b43-bd2e-baa5307a5b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:50:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Volume volume-668332a5-962c-4c70-8f90-041033238ce0 (668332a5-962c-4c70-8f90-041033238ce0): created successfully Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20a032e-e519-4b43-bd2e-baa5307a5b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (24cf4eb5-4a7d-486d-be0d-24027e39d840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:50:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7fc8e083-f5bb-4497-a3d3-8b0e67487215 tempest-AttachVolumeTestJSON-753684111 None] Created volume successfully. Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Creating offline snapshot 11205d63-c2d7-41f6-bd97-e8f972e78fd0 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f348541-a4bb-497c-b779-b4cdd41d09b2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:50 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:50 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Acquiring lock "cinder-quobyte-482692b9-bda4-4440-9fc9-e0f0cc20328d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-482692b9-bda4-4440-9fc9-e0f0cc20328d" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66c05b-be7f-4ae1-abb7-e5a5737121d9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:50 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d Jul 09 02:50:50 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:50 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:50 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 1G Jul 09 02:50:50 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:51 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:51 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d Jul 09 02:50:51 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:51 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 1G" returned: 0 in 1.057s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:52 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 Jul 09 02:50:52 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:52 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-482692b9-bda4-4440-9fc9-e0f0cc20328d" returned: 0 in 0.826s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-482692b9-bda4-4440-9fc9-e0f0cc20328d" released by "delete_volume" :: held 1.687s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Acquiring lock "cinder-quobyte-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc409a08-f7d8-4567-968f-d4148979c7d4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:52 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf Jul 09 02:50:52 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:52 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0" returned: 0 in 0.826s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:52 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 is being set with open permissions: ugo+rw Jul 09 02:50:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:52 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 Jul 09 02:50:52 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:53 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" returned: 0 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:53 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf Jul 09 02:50:53 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:53 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.542s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.697s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bc5fdb-6877-4a28-8524-3f7d1e1bdcfd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-31502d34-ff96-4a6a-ada1-2ffb11611059 tempest-SnapshotsActionsTest-161080406 None] Create snapshot completed successfully Jul 09 02:50:53 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 Jul 09 02:50:53 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:53 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" returned: 0 in 0.673s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "cinder-quobyte-b7f9d4b8-4ec3-41c3-be74-8a5b5346b8bf" released by "delete_volume" :: held 1.502s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Created reservations ['1101251d-8ae6-4c75-9428-1538e25fb78b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:54 devstack cinder-volume[87156]: WARNING cinder.quota [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1336213076 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1336213076, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:50:54 devstack cinder-volume[87156]: WARNING cinder.quota [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1336213076 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1336213076, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Created reservations ['c7a6bef3-d0e2-4f27-80d8-9d343076d472', 'd087e181-8d75-47cb-af50-8acbd3eea5e3', '901b14cc-2154-442f-a89c-92e5dc93231c', 'c90d84c2-bc06-4f2f-ab79-7e1c8c514666'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Created reservations ['cd73d1d7-6f66-4ac9-adfe-1e1cf6a1720a', '8ba47cbb-cc7d-43db-ace3-8fd435f0c3e2', '0e533742-5a1e-489a-b6eb-4930c5837161', '01232d9e-ab85-454c-ae60-6ff8e52efd17'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:54 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:50:54 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:54 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92" returned: 0 in 0.792s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.810s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.753s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[983bc06e-0424-4e56-800d-ba0969a272a1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2934629-0442-46c4-b5b7-3d361fa51aa4', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:50:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-4f34819c-1a23-4e6c-a4d0-1fde0f450028 req-6cb9cdd2-ebdc-481e-b575-17b98c14cff3 tempest-AttachVolumeNegativeTest-1597436921 None] attachment_update completed successfully. Jul 09 02:50:54 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 Jul 09 02:50:54 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:54 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.696s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:50:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-90ef06c7-bade-4fe3-b9e8-93698b2a2fed tempest-GroupsTest-1767431521 None] Delete group completed successfully. Jul 09 02:50:55 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0" returned: 0 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-668332a5-962c-4c70-8f90-041033238ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd17b4257-ace2-4af1-97a6-ea1df5a68db0', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-11205d63-c2d7-41f6-bd97-e8f972e78fd0-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-11205d63-c2d7-41f6-bd97-e8f972e78fd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-81ba4033-4a0c-4bcc-8225-7bdbe5789712 req-dfd3d439-ad4b-44ba-8be3-481d45fc51ca tempest-AttachVolumeTestJSON-753684111 None] attachment_update completed successfully. Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Acquiring lock "cinder-quobyte-11205d63-c2d7-41f6-bd97-e8f972e78fd0" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-11205d63-c2d7-41f6-bd97-e8f972e78fd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Deleting offline snapshot 11205d63-c2d7-41f6-bd97-e8f972e78fd0 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] snapshot_file for this snap is: volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906f0c8-a7d1-4025-893f-e60a55892ee8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:55 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 Jul 09 02:50:55 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:56 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0" returned: 0 in 0.882s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bf082-c96f-41c1-a980-e3c17a272c99]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:50:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:56 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:50:56 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:57 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:50:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:57 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 Jul 09 02:50:57 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:57 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0" returned: 0 in 0.852s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:50:57 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0 Jul 09 02:50:57 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:50:58 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.11205d63-c2d7-41f6-bd97-e8f972e78fd0" returned: 0 in 0.840s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-11205d63-c2d7-41f6-bd97-e8f972e78fd0" released by "_delete_snapshot" :: held 3.473s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_snapshot" :: held 3.498s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=93,cinder:SELECT=89,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=93,cinder:INSERT=18,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Created reservations ['dcf5560e-65cc-454c-ba7b-1152bc67b5bf', '40a035a3-b301-4b61-ae52-13cc87fec65c', '890c786e-7a20-4b7a-a88e-be7192abc355', 'f598f6d9-1b3b-4ca6-bcba-974cd198d057'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:50:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Delete snapshot completed successfully. Jul 09 02:50:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-df3502ee-282a-4bdf-b553-af32f6d158a6 tempest-SnapshotsActionsTest-1089897765 None] Lock "cinder-11205d63-c2d7-41f6-bd97-e8f972e78fd0-delete_snapshot" released by "delete_snapshot" :: held 3.679s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (b58f9b6e-2529-4ea2-8f65-8f42a69263b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251a43d5-6ac3-4790-a426-cea5a4b07c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "cinder-255650bd-ff71-4867-b375-07b2264565f3-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251a43d5-6ac3-4790-a426-cea5a4b07c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1563351531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bea9fdb-cf62-4e33-ae5e-ef883e99e199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:00Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06176c4a-6e15-46da-8a81-55a1cb432c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06176c4a-6e15-46da-8a81-55a1cb432c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceee2cd7-bfcf-4480-b2f0-d0451e32ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceee2cd7-bfcf-4480-b2f0-d0451e32ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bea9fdb-cf62-4e33-ae5e-ef883e99e199', 'volume_name': 'volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f050e-b24c-43f8-bd19-cce6ecf725b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f050e-b24c-43f8-bd19-cce6ecf725b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815e9d88-f943-4cf5-ba9b-2cff66c2d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:00 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Volume 3bea9fdb-cf62-4e33-ae5e-ef883e99e199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199', 'volume_size': 1} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1563351531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bea9fdb-cf62-4e33-ae5e-ef883e99e199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d310041fe564bd193247c5b79b42bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:00Z,use_quota=True,user_id='755b9e58a9004801aaf9f4928b84cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Creating volume 3bea9fdb-cf62-4e33-ae5e-ef883e99e199 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:00 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-255650bd-ff71-4867-b375-07b2264565f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:00 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 1073741824 Jul 09 02:51:00 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "cinder-quobyte-255650bd-ff71-4867-b375-07b2264565f3" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-255650bd-ff71-4867-b375-07b2264565f3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Deleting offline snapshot 255650bd-ff71-4867-b375-07b2264565f3 of volume 107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] snapshot_file for this snap is: volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf22dd-6852-4f52-93bc-8e200d600f05]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:00 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:51:00 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:00 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa3f95d6-aecc-4ad9-9db6-46d13b466c18 tempest-GroupsV320Test-1825713039 None] Group tempest-GroupsV320Test-Group-1729810534: creating Jul 09 02:51:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa3f95d6-aecc-4ad9-9db6-46d13b466c18 tempest-GroupsV320Test-1825713039 None] Group tempest-GroupsV320Test-Group-1729810534: created successfully Jul 09 02:51:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fa3f95d6-aecc-4ad9-9db6-46d13b466c18 tempest-GroupsV320Test-1825713039 None] Create group completed successfully. Jul 09 02:51:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-6034c82d-dffe-40e8-8ec4-ed4a5b615a16 req-40891ac4-d989-4b22-904c-40bc3f7ee98a tempest-AttachVolumeNegativeTest-1597436921 None] Terminate volume connection completed successfully. Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-6034c82d-dffe-40e8-8ec4-ed4a5b615a16 req-40891ac4-d989-4b22-904c-40bc3f7ee98a tempest-AttachVolumeNegativeTest-1597436921 None] Deleting attachment e2934629-0442-46c4-b5b7-3d361fa51aa4. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:51:01 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.927s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-107bbac5-fe58-4d3b-a193-608ef7fb8210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:51:01 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 1073741824" returned: 0 in 1.089s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f7013-7c1d-4a39-b0d6-6ee28799c0b0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:01 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 Jul 09 02:51:01 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:01 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 Jul 09 02:51:01 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:02 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" returned: 0 in 0.669s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815e9d88-f943-4cf5-ba9b-2cff66c2d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1ef619-7596-48e1-9ec7-301101ce7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:02 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Volume volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 (3bea9fdb-cf62-4e33-ae5e-ef883e99e199): created successfully Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1ef619-7596-48e1-9ec7-301101ce7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Flow 'volume_create_manager' (b58f9b6e-2529-4ea2-8f65-8f42a69263b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-07235f54-b3bd-41b8-8272-f69cb9c94693 tempest-AttachVolumeTestJSON-753684111 None] Created volume successfully. Jul 09 02:51:02 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210" returned: 0 in 0.880s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:02 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:51:02 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Created reservations ['5302c448-f46d-43ff-87cb-ea00d2b1522a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:02 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:02 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:03 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:03 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3 Jul 09 02:51:03 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:03 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.682s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2b78155a-e6b4-426c-bfc6-2c21a4efe847 tempest-GroupsV320Test-1825713039 None] Delete group completed successfully. Jul 09 02:51:03 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210.255650bd-ff71-4867-b375-07b2264565f3" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-255650bd-ff71-4867-b375-07b2264565f3" released by "_delete_snapshot" :: held 3.440s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_snapshot" :: held 3.472s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:03 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Created reservations ['175be502-4b4d-45da-98db-0fc00188f741', '5aa1078a-e924-4020-96fa-0e3757e7ef7b', '7127be31-8e1f-4a10-82d1-e50ad86a0d7b', '4b884f79-00a6-4c80-98de-86fb9f07e7d4'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Delete snapshot completed successfully. Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a95a8ad-9513-401a-9fea-87b5661c88b4 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-255650bd-ff71-4867-b375-07b2264565f3-delete_snapshot" released by "delete_snapshot" :: held 3.645s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "cinder-107bbac5-fe58-4d3b-a193-608ef7fb8210-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-107bbac5-fe58-4d3b-a193-608ef7fb8210-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d361bd-dc54-4070-ae60-db61eb935f60]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:04 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 Jul 09 02:51:04 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:05 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210" returned: 0 in 1.135s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:05 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210 Jul 09 02:51:05 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:06 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-107bbac5-fe58-4d3b-a193-608ef7fb8210" returned: 0 in 0.926s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-quobyte-107bbac5-fe58-4d3b-a193-608ef7fb8210" released by "delete_volume" :: held 2.158s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Created reservations ['e756de9e-7439-4e40-931d-8aded6fed1de', '76f03668-90f5-4803-9414-04ba66c83dae', '97abea09-07a7-4743-b795-ac5f2e1fa9d6', 'b912df50-6a29-40a8-bdfa-14943d7ad8b6'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfa71e7-d39d-4fe2-a012-a25b267518ce]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:07 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:07 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:07 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 Jul 09 02:51:07 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:07 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" returned: 0 in 0.904s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:07 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.856s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:07 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Deleted volume successfully. Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-59b2b063-3b31-43bf-9121-523ffd789ef8 tempest-SnapshotsActionsTest-161080406 None] Lock "cinder-107bbac5-fe58-4d3b-a193-608ef7fb8210-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1701584b-b5ef-497e-9387-941881ed3529', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:51:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-4c489159-0a27-4695-bc9e-a1ec3f73894f req-e8959077-f5c4-42b0-bf85-51e42779fcea tempest-AttachVolumeTestJSON-753684111 None] attachment_update completed successfully. Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Flow 'volume_create_manager' (418e3b00-4f60-4606-91c6-1dedb02722ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d9904-64f5-42a9-9a77-c95d51c5ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d9904-64f5-42a9-9a77-c95d51c5ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-25221268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa780b19-a5d4-458b-a344-7a95d0fb6c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d186b7718de747fbb2c7c00bcefd4326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:12Z,use_quota=True,user_id='b5987a51063d42b59442d7f0b97301d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c503cd-fb57-4d75-9707-c4d24472f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c503cd-fb57-4d75-9707-c4d24472f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f395e899-1299-4d0f-97c4-ea206bf68dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f395e899-1299-4d0f-97c4-ea206bf68dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa780b19-a5d4-458b-a344-7a95d0fb6c27', 'volume_name': 'volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f214115-b717-454b-a615-2e1a8b135eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f214115-b717-454b-a615-2e1a8b135eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f27fbc8-7cb0-49d2-a89c-94d756937df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume fa780b19-a5d4-458b-a344-7a95d0fb6c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27', 'volume_size': 1} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-25221268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa780b19-a5d4-458b-a344-7a95d0fb6c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d186b7718de747fbb2c7c00bcefd4326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:12Z,use_quota=True,user_id='b5987a51063d42b59442d7f0b97301d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Creating volume fa780b19-a5d4-458b-a344-7a95d0fb6c27 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:11 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:11 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 1073741824 Jul 09 02:51:11 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:12 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 1073741824" returned: 0 in 1.137s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:12 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 Jul 09 02:51:12 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-32a9759f-6aba-4b71-87d0-fdcc5d353a92-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-32a9759f-6aba-4b71-87d0-fdcc5d353a92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-quobyte-32a9759f-6aba-4b71-87d0-fdcc5d353a92" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-32a9759f-6aba-4b71-87d0-fdcc5d353a92" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c66922b-483b-4677-b183-e513ee33da11]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:13 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 Jul 09 02:51:13 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:13 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f27fbc8-7cb0-49d2-a89c-94d756937df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd758671-f8cd-406b-afda-51370c314698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:13 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 (fa780b19-a5d4-458b-a344-7a95d0fb6c27): created successfully Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd758671-f8cd-406b-afda-51370c314698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Flow 'volume_create_manager' (418e3b00-4f60-4606-91c6-1dedb02722ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-96ea32ae-54ff-4bc8-9692-ae8b7d272073 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Created volume successfully. Jul 09 02:51:13 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92" returned: 0 in 0.829s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:13 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92 Jul 09 02:51:13 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-c745edc4-1bed-40c8-a9f8-2eedcf1b7526 req-b6dff52d-1742-462e-a863-5c0cbb44003f tempest-AttachVolumeTestJSON-753684111 None] Terminate volume connection completed successfully. Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-c745edc4-1bed-40c8-a9f8-2eedcf1b7526 req-b6dff52d-1742-462e-a863-5c0cbb44003f tempest-AttachVolumeTestJSON-753684111 None] Deleting attachment d17b4257-ace2-4af1-97a6-ea1df5a68db0. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:51:14 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-32a9759f-6aba-4b71-87d0-fdcc5d353a92" returned: 0 in 0.657s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-32a9759f-6aba-4b71-87d0-fdcc5d353a92" released by "delete_volume" :: held 1.544s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Created reservations ['40096fc0-1964-46d7-9300-2f54d610d6e1', '98183a9c-1902-45e3-beee-37374a32e822', '0f260fee-8651-4642-abbe-04568b327a00', '5ab94ffa-c9c8-4135-952c-a2b4d0939a88'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:14 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:14 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "cinder-fa780b19-a5d4-458b-a344-7a95d0fb6c27-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "cinder-fa780b19-a5d4-458b-a344-7a95d0fb6c27-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "cinder-quobyte-fa780b19-a5d4-458b-a344-7a95d0fb6c27" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "cinder-quobyte-fa780b19-a5d4-458b-a344-7a95d0fb6c27" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a302f7-4592-4f87-b03b-3d6d03a68429]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:15 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 Jul 09 02:51:15 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-c607cbe6-7504-43ae-b65b-789764889a7f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-c607cbe6-7504-43ae-b65b-789764889a7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-quobyte-c607cbe6-7504-43ae-b65b-789764889a7f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-c607cbe6-7504-43ae-b65b-789764889a7f" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a6a69-d0e1-42ef-bb7e-17b99c34dcb6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:15 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.913s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Deleted volume successfully. Jul 09 02:51:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d2bacfb-efea-40f5-a9b3-37ddca4142fd tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-32a9759f-6aba-4b71-87d0-fdcc5d353a92-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:15 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f Jul 09 02:51:15 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:16 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27" returned: 0 in 1.021s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:16 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27 Jul 09 02:51:16 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:16 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f" returned: 0 in 0.904s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:16 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f Jul 09 02:51:16 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-d60bc566-1140-4fdc-adc3-58db5282baaf req-0e90751b-3bd7-45ab-bbeb-d1994cec593c tempest-AttachVolumeTestJSON-753684111 None] Terminate volume connection completed successfully. Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-d60bc566-1140-4fdc-adc3-58db5282baaf req-0e90751b-3bd7-45ab-bbeb-d1994cec593c tempest-AttachVolumeTestJSON-753684111 None] Deleting attachment 1701584b-b5ef-497e-9387-941881ed3529. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:51:16 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fa780b19-a5d4-458b-a344-7a95d0fb6c27" returned: 0 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "cinder-quobyte-fa780b19-a5d4-458b-a344-7a95d0fb6c27" released by "delete_volume" :: held 1.918s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Created reservations ['d6dd3569-4d72-4479-bf5d-4b4fd6ac81db', '10118e3f-0ddf-4122-9fa4-6165d8e3a795', 'e7fc76fe-b090-484b-a3d5-a407b09c1529', '3f103aba-9fae-412b-b9c9-e7d0fec43efc'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:17 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:17 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:17 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c607cbe6-7504-43ae-b65b-789764889a7f" returned: 0 in 0.856s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-c607cbe6-7504-43ae-b65b-789764889a7f" released by "delete_volume" :: held 1.832s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Created reservations ['9da87bfc-0501-40ea-915b-0f48ec1db4ba', '9cbdd6a0-be2c-4d3c-b95e-b1072f9e1542', '2a141f2e-b2a2-4c7c-a2a0-1d5a80b2ecc0', '81ee7a3e-0d68-45d7-bbb4-4ea4e5583f1e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:17 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:17 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:18 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.961s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Deleted volume successfully. Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "cinder-quobyte-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b41f76ad-c143-44bb-80da-a9ee52b42a4f tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "cinder-fa780b19-a5d4-458b-a344-7a95d0fb6c27-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab03e58-0511-4ceb-86d6-429374a48e71]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Flow 'volume_create_manager' (ec1a13d5-35d4-418e-be4c-af4512fb540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:18 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 Jul 09 02:51:18 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398cd5f-9a3e-48a7-9d02-5297a3e3186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398cd5f-9a3e-48a7-9d02-5297a3e3186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-894651379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c689c604-c943-4ed7-8346-26703653ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d186b7718de747fbb2c7c00bcefd4326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:18Z,use_quota=True,user_id='b5987a51063d42b59442d7f0b97301d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d236f8f-551f-40b4-847a-f209c66c6380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d236f8f-551f-40b4-847a-f209c66c6380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4de204-1bda-43c5-bdbf-3b6177bbfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4de204-1bda-43c5-bdbf-3b6177bbfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c689c604-c943-4ed7-8346-26703653ae98', 'volume_name': 'volume-c689c604-c943-4ed7-8346-26703653ae98', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aee3b47-3521-43da-a4e0-e31e6b14c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aee3b47-3521-43da-a4e0-e31e6b14c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530ed32-fc8e-471f-b04b-c2eb70ac4335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume c689c604-c943-4ed7-8346-26703653ae98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c689c604-c943-4ed7-8346-26703653ae98', 'volume_size': 1} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-894651379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c689c604-c943-4ed7-8346-26703653ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d186b7718de747fbb2c7c00bcefd4326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:18Z,use_quota=True,user_id='b5987a51063d42b59442d7f0b97301d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Creating volume c689c604-c943-4ed7-8346-26703653ae98 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:18 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:18 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 1073741824 Jul 09 02:51:18 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:18 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.966s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Deleted volume successfully. Jul 09 02:51:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94e31f1c-7ec4-46af-ac50-f2abe74f4810 tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-c607cbe6-7504-43ae-b65b-789764889a7f-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:19 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" returned: 0 in 0.918s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:19 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9 Jul 09 02:51:19 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:19 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 1073741824" returned: 0 in 0.974s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:19 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 Jul 09 02:51:19 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:19 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" returned: 0 in 0.776s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-quobyte-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9" released by "delete_volume" :: held 1.734s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:19 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Created reservations ['d0e1a1dd-2614-4023-be99-3baf93cac101', 'ef0320dd-f058-4174-a971-d5bf8c3ce955', '4ca75945-9603-4e1d-bc9f-530f58671dbb', '8d45600a-875d-4e93-8cf3-9ed985bd1d8f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:20 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:20 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:20 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98" returned: 0 in 0.786s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530ed32-fc8e-471f-b04b-c2eb70ac4335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c689c604-c943-4ed7-8346-26703653ae98', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fcb096-6914-4a18-9e36-1caf38478e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Volume volume-c689c604-c943-4ed7-8346-26703653ae98 (c689c604-c943-4ed7-8346-26703653ae98): created successfully Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fcb096-6914-4a18-9e36-1caf38478e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Flow 'volume_create_manager' (ec1a13d5-35d4-418e-be4c-af4512fb540b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f05ccd44-f49b-4a41-8557-bacca62fc287 tempest-VolumeQuotasAdminTestJSON-1027965871 None] Created volume successfully. Jul 09 02:51:20 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.794s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Deleted volume successfully. Jul 09 02:51:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7161c324-4a0a-4878-bce4-ccf6ce46549c tempest-AttachVolumeNegativeTest-1597436921 None] Lock "cinder-3ad9f386-e55e-4a0e-b1e0-c81b6e957de9-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4ca64dc4-20e6-4a5d-b06f-75f20a17a5b6 tempest-VolumeQuotasAdminTestJSON-2061261814 None] Transfer volume completed successfully. Jul 09 02:51:22 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Flow 'volume_create_manager' (5f7ba332-1085-48c9-af55-e6272fd77717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffaf2b9-6898-42bf-8583-fe8c1e80bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffaf2b9-6898-42bf-8583-fe8c1e80bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-346196507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0f47f1-660f-42e9-88e9-9cfe1c95b552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c08c1881e7a45ffbae0302fc1727800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:23Z,use_quota=True,user_id='3c8e6b4d928247ef984713d065ae8680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f6d264-cbb5-429a-adf9-00ff0e6a0f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f6d264-cbb5-429a-adf9-00ff0e6a0f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8b160c-90fb-4905-8a19-3ecd7f10a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8b160c-90fb-4905-8a19-3ecd7f10a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0f47f1-660f-42e9-88e9-9cfe1c95b552', 'volume_name': 'volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8714af8-a8e3-4451-9489-e4c0637cd484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8714af8-a8e3-4451-9489-e4c0637cd484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993794cb-a06b-43ee-9034-6d7f41c54ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:23 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Volume 8f0f47f1-660f-42e9-88e9-9cfe1c95b552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552', 'volume_size': 1} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-346196507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0f47f1-660f-42e9-88e9-9cfe1c95b552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c08c1881e7a45ffbae0302fc1727800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:23Z,use_quota=True,user_id='3c8e6b4d928247ef984713d065ae8680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Creating volume 8f0f47f1-660f-42e9-88e9-9cfe1c95b552 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:23 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:23 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 1073741824 Jul 09 02:51:23 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Acquiring lock "cinder-c689c604-c943-4ed7-8346-26703653ae98-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "cinder-c689c604-c943-4ed7-8346-26703653ae98-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Acquiring lock "cinder-quobyte-c689c604-c943-4ed7-8346-26703653ae98" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "cinder-quobyte-c689c604-c943-4ed7-8346-26703653ae98" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c14b3-62e7-4a64-9cbf-6d0015f3217e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:23 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 Jul 09 02:51:23 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:24 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 1073741824" returned: 0 in 1.051s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:24 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 Jul 09 02:51:24 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:24 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98" returned: 0 in 0.945s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:24 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98 Jul 09 02:51:24 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:24 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993794cb-a06b-43ee-9034-6d7f41c54ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa1498-e37e-4307-9576-e72741d35f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Volume volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 (8f0f47f1-660f-42e9-88e9-9cfe1c95b552): created successfully Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa1498-e37e-4307-9576-e72741d35f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Flow 'volume_create_manager' (5f7ba332-1085-48c9-af55-e6272fd77717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7f8935ef-1ba0-4174-ba9e-16a921281f5a tempest-VolumesMetadataTest-1055404810 None] Created volume successfully. Jul 09 02:51:25 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c689c604-c943-4ed7-8346-26703653ae98" returned: 0 in 0.882s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "cinder-quobyte-c689c604-c943-4ed7-8346-26703653ae98" released by "delete_volume" :: held 1.880s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Created reservations ['4d7ecd46-eb58-498a-9a6a-a69e713e6402', '916fb60a-009f-4398-882f-52fd45bc1785', '53d047bd-d8f5-4cb8-8e69-1ea1649cc81b', 'ea343365-83cc-44f9-aedd-896a2010cb4c'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:25 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:25 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Acquiring lock "cinder-8f0f47f1-660f-42e9-88e9-9cfe1c95b552-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "cinder-8f0f47f1-660f-42e9-88e9-9cfe1c95b552-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Acquiring lock "cinder-quobyte-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "cinder-quobyte-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[360d15a4-4219-4b2a-adc2-217aabc5bd09]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:26 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 Jul 09 02:51:26 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:26 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.935s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Deleted volume successfully. Jul 09 02:51:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0950c9a-ab99-4e57-afe8-e4f740443312 tempest-VolumeQuotasAdminTestJSON-199435371 None] Lock "cinder-c689c604-c943-4ed7-8346-26703653ae98-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:27 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" returned: 0 in 1.140s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:27 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552 Jul 09 02:51:27 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:27 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:27 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-3bea9fdb-cf62-4e33-ae5e-ef883e99e199-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-3bea9fdb-cf62-4e33-ae5e-ef883e99e199-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-quobyte-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b9924-898f-4e13-a1bf-96a335eef931]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:28 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 Jul 09 02:51:28 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:28 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" returned: 0 in 1.114s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "cinder-quobyte-8f0f47f1-660f-42e9-88e9-9cfe1c95b552" released by "delete_volume" :: held 2.318s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Created reservations ['c8215ade-8814-4eb6-b9de-81f9115aae50', '7d901527-2c05-4954-82da-ef706b014ff3', '0e4e8b81-251a-46c6-b965-f48fecf4fd6e', '707bc6cb-9697-48a6-9cc1-8a24a5441c49'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:28 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:28 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:29 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.085s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:51:29 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" returned: 0 in 1.098s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:29 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199 Jul 09 02:51:29 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:29 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.907s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Deleted volume successfully. Jul 09 02:51:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-008e6c3b-54c2-43e4-b5e1-c49a7553af3e tempest-VolumesMetadataTest-1055404810 None] Lock "cinder-8f0f47f1-660f-42e9-88e9-9cfe1c95b552-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:30 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" returned: 0 in 0.864s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-3bea9fdb-cf62-4e33-ae5e-ef883e99e199" released by "delete_volume" :: held 2.009s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Created reservations ['7a0b4cbc-f9e9-4fda-aad9-b1778396db15', 'dc0e304a-6706-4ad9-b0d3-5cb4acb367c3', '3310f010-ddd5-40d0-9835-7a7e93f73fe7', '8eed77ef-6d2f-4fe3-838c-7617dd8edc77'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:30 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:30 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-668332a5-962c-4c70-8f90-041033238ce0-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (de7171ee-b1de-48c6-ad42-69751ae1ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22946e26-1e98-4388-b7c7-b58772d823fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-668332a5-962c-4c70-8f90-041033238ce0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22946e26-1e98-4388-b7c7-b58772d823fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1281086380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc7e397-0217-440e-98d1-44e5af088860,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:30Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeab59d-5513-4540-b396-4b5f97ffd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeab59d-5513-4540-b396-4b5f97ffd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ea9e5-d0a7-4b93-9b95-31d137dd9f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ea9e5-d0a7-4b93-9b95-31d137dd9f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc7e397-0217-440e-98d1-44e5af088860', 'volume_name': 'volume-5fc7e397-0217-440e-98d1-44e5af088860', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75015f7d-fbff-45e7-adab-440bfdf9d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75015f7d-fbff-45e7-adab-440bfdf9d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ae7b9f-05d2-40ca-ad5d-b422d27e4925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Volume 5fc7e397-0217-440e-98d1-44e5af088860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc7e397-0217-440e-98d1-44e5af088860', 'volume_size': 1} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1281086380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc7e397-0217-440e-98d1-44e5af088860,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:30Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Creating volume 5fc7e397-0217-440e-98d1-44e5af088860 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:30 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-quobyte-668332a5-962c-4c70-8f90-041033238ce0" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:30 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 1073741824 Jul 09 02:51:30 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-668332a5-962c-4c70-8f90-041033238ce0" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6762eb02-db4f-46a6-862f-769fc7f02432]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:30 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 Jul 09 02:51:30 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:31 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.914s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Deleted volume successfully. Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e4ffb641-3224-48c9-9aa0-f6fa780f1300 tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-3bea9fdb-cf62-4e33-ae5e-ef883e99e199-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:31 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0" returned: 0 in 1.142s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:31 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0 Jul 09 02:51:31 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:31 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 1073741824" returned: 0 in 1.324s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:31 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 Jul 09 02:51:31 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:32 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-668332a5-962c-4c70-8f90-041033238ce0" returned: 0 in 0.860s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-668332a5-962c-4c70-8f90-041033238ce0" released by "delete_volume" :: held 2.056s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Created reservations ['98992d06-4266-4359-9a94-3134a6a1ab16', '415052ee-6819-4440-809d-14a2ddd9fc70', '1093b93c-c71f-4254-9e2e-7317e5244b36', 'ddf2f8e0-c73a-453c-bd5d-de4530324179'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:32 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ae7b9f-05d2-40ca-ad5d-b422d27e4925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc7e397-0217-440e-98d1-44e5af088860', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffffeafd-486d-475c-b612-ae1e91f742bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:32 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Volume volume-5fc7e397-0217-440e-98d1-44e5af088860 (5fc7e397-0217-440e-98d1-44e5af088860): created successfully Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffffeafd-486d-475c-b612-ae1e91f742bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (de7171ee-b1de-48c6-ad42-69751ae1ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:32 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8ac03009-f75a-45c9-a246-2e46dd8f04f3 tempest-VolumesTestJSON-1767271426 None] Created volume successfully. Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:32 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:32 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:33 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:33 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:33 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Deleted volume successfully. Jul 09 02:51:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e24b5984-1317-4cdd-a220-4096c266a08d tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-668332a5-962c-4c70-8f90-041033238ce0-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-6a7d4b19-59a0-4adb-8a67-71e19bc8a334-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-6a7d4b19-59a0-4adb-8a67-71e19bc8a334-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "cinder-quobyte-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57a9991-7d89-488f-a512-0ecef730e669]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (2323a801-671c-412a-8fbd-f25f9f143adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ddb398-8040-437d-9a76-c73a5200442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ddb398-8040-437d-9a76-c73a5200442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1581319583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f56034e-c5f6-4c8e-a861-bb4abd2de26f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:34Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafb3d11-6f21-4c6b-afb7-2c4cc70c3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafb3d11-6f21-4c6b-afb7-2c4cc70c3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aacd61-2bbf-458c-9e82-0ccf43df16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aacd61-2bbf-458c-9e82-0ccf43df16fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f56034e-c5f6-4c8e-a861-bb4abd2de26f', 'volume_name': 'volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:34 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 Jul 09 02:51:34 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80713a43-3a92-4fa3-be06-eb5a8fbba79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80713a43-3a92-4fa3-be06-eb5a8fbba79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1621fd-c6cf-42f4-8b61-f92c7ceaf217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:34 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Volume 8f56034e-c5f6-4c8e-a861-bb4abd2de26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f', 'volume_size': 1} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1581319583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f56034e-c5f6-4c8e-a861-bb4abd2de26f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:34Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Creating volume 8f56034e-c5f6-4c8e-a861-bb4abd2de26f {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:34 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:34 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f 1073741824 Jul 09 02:51:34 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:35 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" returned: 0 in 0.970s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:35 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334 Jul 09 02:51:35 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:35 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f 1073741824" returned: 0 in 1.095s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:35 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f Jul 09 02:51:35 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:36 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" returned: 0 in 0.947s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-quobyte-6a7d4b19-59a0-4adb-8a67-71e19bc8a334" released by "delete_volume" :: held 2.027s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Created reservations ['b5f5882a-e406-4b9f-a563-6e7742fcf9e9', 'a08254dd-556a-42b5-a200-e714d49c845b', '63d40481-ab17-4b84-bf34-95a9c16eef10', 'cf976caf-8cf1-472c-a657-fd6c5a3cdb99'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Flow 'volume_create_manager' (12b4382a-b003-4c52-a149-32a5a13a0a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9db4af-f58f-40d3-8c5f-8f9213ad92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9db4af-f58f-40d3-8c5f-8f9213ad92ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-450046485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21f9ed5-a8fc-4c88-ac59-ed53d796c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0abb6fbfb04b3cb2015368871cb8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:36Z,use_quota=True,user_id='6779be7c6d254a6cb73f2ee0b4b3fda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad50f71-2d9e-4631-ab11-2d39a66b153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad50f71-2d9e-4631-ab11-2d39a66b153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020408f-852c-4b54-a12c-126657021877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d020408f-852c-4b54-a12c-126657021877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21f9ed5-a8fc-4c88-ac59-ed53d796c631', 'volume_name': 'volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc18dcbc-4f9b-4958-af86-f8832cd891c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc18dcbc-4f9b-4958-af86-f8832cd891c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df85a69a-7bf5-4a87-8b41-d19d0be66041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Volume f21f9ed5-a8fc-4c88-ac59-ed53d796c631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631', 'volume_size': 1} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:36 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" returned: 0 in 0.937s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-450046485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21f9ed5-a8fc-4c88-ac59-ed53d796c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0abb6fbfb04b3cb2015368871cb8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:36Z,use_quota=True,user_id='6779be7c6d254a6cb73f2ee0b4b3fda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Creating volume f21f9ed5-a8fc-4c88-ac59-ed53d796c631 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:36 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:36 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:36 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1621fd-c6cf-42f4-8b61-f92c7ceaf217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 1073741824 Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf7963f-3bc9-492e-97a2-d8a3520dea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:36 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:36 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Volume volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f (8f56034e-c5f6-4c8e-a861-bb4abd2de26f): created successfully Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf7963f-3bc9-492e-97a2-d8a3520dea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (2323a801-671c-412a-8fbd-f25f9f143adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6e8d5081-13e6-4c04-94d4-2ad816360cd0 tempest-VolumesTestJSON-1767271426 None] Created volume successfully. Jul 09 02:51:37 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.656s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:37 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Deleted volume successfully. Jul 09 02:51:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f395c567-2899-4a3b-b5ce-c68e21e93edc tempest-AttachVolumeTestJSON-753684111 None] Lock "cinder-6a7d4b19-59a0-4adb-8a67-71e19bc8a334-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:37 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 1073741824" returned: 0 in 1.057s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:37 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 Jul 09 02:51:37 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (9215d4f4-3b46-4b41-8fc2-7653f968aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505479d1-6a32-4a43-be82-254fbfb7ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505479d1-6a32-4a43-be82-254fbfb7ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102526410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5169d1d-bce9-4f22-a06a-5990b4f55582,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:38Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda598e9-b9f6-4946-9510-31ba659e2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda598e9-b9f6-4946-9510-31ba659e2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b320530-8348-4a06-a672-821799168527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b320530-8348-4a06-a672-821799168527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5169d1d-bce9-4f22-a06a-5990b4f55582', 'volume_name': 'volume-d5169d1d-bce9-4f22-a06a-5990b4f55582', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827a96de-7b86-4b59-aea4-b264c8c5e10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827a96de-7b86-4b59-aea4-b264c8c5e10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b45e020-7a20-4f6b-abb4-0b39923110fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Volume d5169d1d-bce9-4f22-a06a-5990b4f55582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5169d1d-bce9-4f22-a06a-5990b4f55582', 'volume_size': 1} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:38 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" returned: 0 in 0.898s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-102526410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5169d1d-bce9-4f22-a06a-5990b4f55582,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d374792911f04c73831d1ad09c38a9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:38Z,use_quota=True,user_id='9a73243c683d41be8484ada57aa45a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Creating volume d5169d1d-bce9-4f22-a06a-5990b4f55582 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df85a69a-7bf5-4a87-8b41-d19d0be66041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 1073741824 Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8806f44c-e31f-4851-ac41-f4ee46936e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:38 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Volume volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 (f21f9ed5-a8fc-4c88-ac59-ed53d796c631): created successfully Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8806f44c-e31f-4851-ac41-f4ee46936e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Flow 'volume_create_manager' (12b4382a-b003-4c52-a149-32a5a13a0a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-de45f0d3-6b23-4c20-a12a-f750f9d8a670 tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Created volume successfully. Jul 09 02:51:39 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 1073741824" returned: 0 in 1.188s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:39 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 Jul 09 02:51:39 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:40 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582" returned: 0 in 0.886s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b45e020-7a20-4f6b-abb4-0b39923110fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5169d1d-bce9-4f22-a06a-5990b4f55582', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a054d4f0-5537-4a71-b221-94bb1ef537ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:40 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Volume volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 (d5169d1d-bce9-4f22-a06a-5990b4f55582): created successfully Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a054d4f0-5537-4a71-b221-94bb1ef537ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Flow 'volume_create_manager' (9215d4f4-3b46-4b41-8fc2-7653f968aa87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e1ceb904-0597-449a-adc3-41c7b285f196 tempest-VolumesTestJSON-1767271426 None] Created volume successfully. Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Acquiring lock "cinder-f21f9ed5-a8fc-4c88-ac59-ed53d796c631-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "cinder-f21f9ed5-a8fc-4c88-ac59-ed53d796c631-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Acquiring lock "cinder-quobyte-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "cinder-quobyte-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d6540-0982-421e-98c2-ea3b93cb92cc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:41 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 Jul 09 02:51:41 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:42 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" returned: 0 in 0.949s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:42 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631 Jul 09 02:51:42 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-d5169d1d-bce9-4f22-a06a-5990b4f55582-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "cinder-d5169d1d-bce9-4f22-a06a-5990b4f55582-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-quobyte-d5169d1d-bce9-4f22-a06a-5990b4f55582" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-d5169d1d-bce9-4f22-a06a-5990b4f55582" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9718fe2f-e7c5-4e79-99fb-ccaf2cccea70]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:43 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" returned: 0 in 1.077s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "cinder-quobyte-f21f9ed5-a8fc-4c88-ac59-ed53d796c631" released by "delete_volume" :: held 2.077s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Created reservations ['4e0a7128-e6d0-428b-9085-e7cfa8db4073', '2b5a931f-e1e0-4420-ad0c-8b5b5e8a1fda', 'd9193808-7c8f-466e-8ada-9c0dbc5bc16d', '9d018bde-7f7d-4a03-b42e-ff98d6cc8dd7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:43 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 Jul 09 02:51:43 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:43 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:43 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:44 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582" returned: 0 in 1.320s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:44 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.077s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:44 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Deleted volume successfully. Jul 09 02:51:44 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582 Jul 09 02:51:44 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83923d40-87aa-4ff9-a7d6-e3571da094cc tempest-VolumeQuotasNegativeTestJSON-2041779888 None] Lock "cinder-f21f9ed5-a8fc-4c88-ac59-ed53d796c631-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:45 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5169d1d-bce9-4f22-a06a-5990b4f55582" returned: 0 in 0.868s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-d5169d1d-bce9-4f22-a06a-5990b4f55582" released by "delete_volume" :: held 2.267s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Created reservations ['89735abb-01d8-47fb-a355-e34e67089163', '924e38fd-af36-4feb-8e89-7819b082a57a', 'e4c391c2-ce10-472e-8be9-60c1e5b41ec2', 'cd46c156-8e32-43af-89d4-c723b87bd031'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:45 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:45 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-8f56034e-c5f6-4c8e-a861-bb4abd2de26f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-8f56034e-c5f6-4c8e-a861-bb4abd2de26f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-quobyte-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:46 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.002s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16e97e-0417-4b00-878e-44d38348f8e7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Deleted volume successfully. Jul 09 02:51:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e57c045-2e82-4454-a9be-81caa9c2906e tempest-VolumesTestJSON-1767271426 None] Lock "cinder-d5169d1d-bce9-4f22-a06a-5990b4f55582-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:46 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f Jul 09 02:51:46 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:47 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" returned: 0 in 1.002s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:47 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f Jul 09 02:51:47 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Flow 'volume_create_manager' (c6af3da9-bc8a-4252-86fd-6ffc117bcf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036bc9b3-27d2-4d85-8ce8-f8f48511bc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036bc9b3-27d2-4d85-8ce8-f8f48511bc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-780753559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fa9e37-fcd4-4dfd-8c08-78e04c268b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece8cbbd589940da946db0fe4baaf17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:48Z,use_quota=True,user_id='06106e784b0b4ccba11b7f97c207fee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83134736-62ac-4237-9553-1b77d5a0dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83134736-62ac-4237-9553-1b77d5a0dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e00227-0c09-4053-9336-db045704b0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e00227-0c09-4053-9336-db045704b0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fa9e37-fcd4-4dfd-8c08-78e04c268b13', 'volume_name': 'volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62bc424-7fb3-43f6-a8be-2610257057d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62bc424-7fb3-43f6-a8be-2610257057d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f31134-8621-4941-bd02-a2f9544c91db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Volume b0fa9e37-fcd4-4dfd-8c08-78e04c268b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13', 'volume_size': 1} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-780753559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fa9e37-fcd4-4dfd-8c08-78e04c268b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece8cbbd589940da946db0fe4baaf17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:48Z,use_quota=True,user_id='06106e784b0b4ccba11b7f97c207fee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Creating volume b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:48 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 1073741824 Jul 09 02:51:48 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:48 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" returned: 0 in 0.846s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-8f56034e-c5f6-4c8e-a861-bb4abd2de26f" released by "delete_volume" :: held 1.926s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Flow 'volume_create_manager' (322d2e96-160e-4201-b91c-8f6e93d7426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c7c0ff-aa0e-415b-81dc-86326e78abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c7c0ff-aa0e-415b-81dc-86326e78abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-816148618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de06abcf-a9e7-4a52-b83b-894fc29476b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ba4797c70540908498b034b73461be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:48Z,use_quota=True,user_id='e35b16bc8ab344cbb098f80e50baa4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5acd67-7079-43eb-b3ac-0eb50591e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5acd67-7079-43eb-b3ac-0eb50591e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fc6b0f-7e27-4ced-86e3-a0ccf75d950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fc6b0f-7e27-4ced-86e3-a0ccf75d950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de06abcf-a9e7-4a52-b83b-894fc29476b6', 'volume_name': 'volume-de06abcf-a9e7-4a52-b83b-894fc29476b6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015bedd1-87e5-4b1e-8603-a77ccd713dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015bedd1-87e5-4b1e-8603-a77ccd713dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df3e139-a7c2-475a-8eb2-4097cfdabae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Volume de06abcf-a9e7-4a52-b83b-894fc29476b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de06abcf-a9e7-4a52-b83b-894fc29476b6', 'volume_size': 1} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Created reservations ['ed80986f-c9f3-4f58-a820-d4b5081d9ded', 'a4724305-d592-46fc-99ec-f60dfe33c4ec', 'da3c45b9-3d9d-4306-8026-603c92ca26cb', '3a06faf1-bb5c-491b-ba8d-c06f9446ee41'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:48 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:48 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-5fc7e397-0217-440e-98d1-44e5af088860-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-5fc7e397-0217-440e-98d1-44e5af088860-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "cinder-quobyte-5fc7e397-0217-440e-98d1-44e5af088860" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-5fc7e397-0217-440e-98d1-44e5af088860" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1036768-becd-400c-bd94-e4f95edae2d0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:49 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 1073741824" returned: 0 in 1.063s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:49 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 Jul 09 02:51:49 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:49 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 Jul 09 02:51:49 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:49 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Deleted volume successfully. Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-09fceb39-9159-4481-970e-978ec4552d23 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-8f56034e-c5f6-4c8e-a861-bb4abd2de26f-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:49 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860" returned: 0 in 0.908s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:49 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-816148618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de06abcf-a9e7-4a52-b83b-894fc29476b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ba4797c70540908498b034b73461be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:51:48Z,use_quota=True,user_id='e35b16bc8ab344cbb098f80e50baa4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Creating volume de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:49 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860 Jul 09 02:51:49 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:51:49 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:51:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f31134-8621-4941-bd02-a2f9544c91db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76021cba-5e89-41fa-8e25-bae061d2a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Volume volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 (b0fa9e37-fcd4-4dfd-8c08-78e04c268b13): created successfully Jul 09 02:51:50 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 1073741824 Jul 09 02:51:50 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76021cba-5e89-41fa-8e25-bae061d2a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Flow 'volume_create_manager' (c6af3da9-bc8a-4252-86fd-6ffc117bcf97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-b83c66f5-60f0-45bf-88fa-72bf1f3ddf96 req-0560a108-b7b2-4eb7-b027-94885413337f tempest-VolumesSnapshotsTestJSON-186628452 None] Created volume successfully. Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:50 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5fc7e397-0217-440e-98d1-44e5af088860" returned: 0 in 0.874s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-quobyte-5fc7e397-0217-440e-98d1-44e5af088860" released by "delete_volume" :: held 1.838s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Created reservations ['c96de85d-6686-47e7-9ba5-d5b887f36bdc', 'eee7a8f8-c69e-46ca-abfe-b6c7ab6bbebe', '0d1935ec-b566-470a-91bc-21aa4ce1e03d', '9a8aa2c2-65c7-44df-bf0f-1b7ccfd1a1c8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:51 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:51:51 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:51 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 1073741824" returned: 0 in 1.190s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:51 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:51:51 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:51 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.767s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:51:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Deleted volume successfully. Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-76b74f20-e219-454a-bd19-324a8021b5b6 tempest-VolumesTestJSON-1767271426 None] Lock "cinder-5fc7e397-0217-440e-98d1-44e5af088860-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:51:51 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.745s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.343s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:51:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Creating offline snapshot ab1e941e-6927-4715-8c74-d37f8fb30475 of volume b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df3e139-a7c2-475a-8eb2-4097cfdabae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de06abcf-a9e7-4a52-b83b-894fc29476b6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc17aef9-761d-4105-88ab-8e210859270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e6d3a-8825-48fc-a4d4-49e7a9726f7e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Volume volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 (de06abcf-a9e7-4a52-b83b-894fc29476b6): created successfully Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc17aef9-761d-4105-88ab-8e210859270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:51:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Flow 'volume_create_manager' (322d2e96-160e-4201-b91c-8f6e93d7426d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:51:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-999dadec-ec0a-4f4f-a17a-b51f1f8fd529 tempest-VolumesActionsTest-1887345895 None] Created volume successfully. Jul 09 02:51:52 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 Jul 09 02:51:52 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:53 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" returned: 0 in 0.975s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:53 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 1G Jul 09 02:51:53 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:53 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 1G" returned: 0 in 0.989s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:54 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 Jul 09 02:51:54 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:54 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475" returned: 0 in 0.889s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:54 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 is being set with open permissions: ugo+rw Jul 09 02:51:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:54 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 Jul 09 02:51:54 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:55 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475" returned: 0 in 0.717s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:55 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info Jul 09 02:51:55 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:56 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info" returned: 0 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:56 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info is being set with open permissions: ugo+rw Jul 09 02:51:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:56 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info Jul 09 02:51:56 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:57 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.info" returned: 0 in 0.781s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.226s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:51:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-c496ce3f-84d9-499f-9e75-0f7dcaaddba6 req-227c1bec-1671-4519-aaba-c22f3ad21577 tempest-VolumesSnapshotsTestJSON-186628452 None] Create snapshot completed successfully Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "cinder-ab1e941e-6927-4715-8c74-d37f8fb30475-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-ab1e941e-6927-4715-8c74-d37f8fb30475-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "cinder-quobyte-ab1e941e-6927-4715-8c74-d37f8fb30475" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-ab1e941e-6927-4715-8c74-d37f8fb30475" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Deleting offline snapshot ab1e941e-6927-4715-8c74-d37f8fb30475 of volume b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] snapshot_file for this snap is: volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ba410-cc91-4b0f-8f2c-3cfe52363cd5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:58 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 Jul 09 02:51:58 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:51:58 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 09 02:51:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475" returned: 0 in 0.962s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:51:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:51:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f2bc25-c6d3-4367-b92b-9650cdba5653]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:51:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:51:59 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 Jul 09 02:51:59 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:00 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" returned: 0 in 1.279s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:00 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 Jul 09 02:52:00 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=114,cinder:INSERT=37,cinder:UPDATE=179,cinder:DELETE=13 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:52:01 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475" returned: 0 in 1.077s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:INSERT=39,cinder:UPDATE=142,cinder:SELECT=124,cinder:DELETE=12 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:52:01 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475 Jul 09 02:52:01 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Flow 'volume_create_manager' (ed580003-55f0-4bb0-a2ea-3b4dc5a19583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b801e593-2471-49ba-8741-2daba13dc1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b801e593-2471-49ba-8741-2daba13dc1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-191755024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4212da-8010-44bd-9ec2-d88b37995f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73d4b947ee74095a109e1be37b8d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:01Z,use_quota=True,user_id='f08bfe66770b4427951af36da487f3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f93529-3bf3-4c62-903c-adaa675178c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f93529-3bf3-4c62-903c-adaa675178c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa29320e-a8f6-4455-8d0d-f0c62edfb95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa29320e-a8f6-4455-8d0d-f0c62edfb95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a4212da-8010-44bd-9ec2-d88b37995f40', 'volume_name': 'volume-8a4212da-8010-44bd-9ec2-d88b37995f40', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0beae4-e490-44d4-a099-75302ee6ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0beae4-e490-44d4-a099-75302ee6ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5485c-64dd-46e6-b3bc-7466ac9b1d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Volume 8a4212da-8010-44bd-9ec2-d88b37995f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a4212da-8010-44bd-9ec2-d88b37995f40', 'volume_size': 1} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-191755024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4212da-8010-44bd-9ec2-d88b37995f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73d4b947ee74095a109e1be37b8d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:01Z,use_quota=True,user_id='f08bfe66770b4427951af36da487f3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Creating volume 8a4212da-8010-44bd-9ec2-d88b37995f40 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:01 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:01 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 1073741824 Jul 09 02:52:01 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:02 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13.ab1e941e-6927-4715-8c74-d37f8fb30475" returned: 0 in 0.766s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-ab1e941e-6927-4715-8c74-d37f8fb30475" released by "_delete_snapshot" :: held 4.223s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" released by "delete_snapshot" :: held 4.255s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.quota [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Created reservations ['43503a2b-20bd-4203-9669-e965a06d8720', '43b86785-452f-45c5-9d2b-2d1da6e23d66', '9cb2f68a-d339-4eee-adff-f0001b1b558f', '7c2dcb48-ac9b-451b-ad21-cc8edf3d3e84'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Delete snapshot completed successfully. Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-dc9962e2-4790-4f48-b254-17f9fe054262 req-3da25227-d4df-4c84-b1e2-0fca9af6a621 tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-ab1e941e-6927-4715-8c74-d37f8fb30475-delete_snapshot" released by "delete_snapshot" :: held 4.420s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "cinder-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:02 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 1073741824" returned: 0 in 0.993s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615d2b3-9e9d-4e2b-a079-78c0bbf84da2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:02 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 Jul 09 02:52:02 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:02 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 Jul 09 02:52:02 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:03 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" returned: 0 in 0.835s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:03 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:03 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13 Jul 09 02:52:03 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5485c-64dd-46e6-b3bc-7466ac9b1d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4212da-8010-44bd-9ec2-d88b37995f40', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cb466e-fdb0-4273-be06-68763823518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:03 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Volume volume-8a4212da-8010-44bd-9ec2-d88b37995f40 (8a4212da-8010-44bd-9ec2-d88b37995f40): created successfully Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cb466e-fdb0-4273-be06-68763823518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Flow 'volume_create_manager' (ed580003-55f0-4bb0-a2ea-3b4dc5a19583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2c8011ba-5ace-4b22-a3f3-3f48afca07b9 tempest-AbsoluteLimitsTests-1341082146 None] Created volume successfully. Jul 09 02:52:04 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" returned: 0 in 0.663s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-quobyte-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13" released by "delete_volume" :: held 1.577s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.quota [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Created reservations ['6d24de01-b5a7-45ac-9b53-86a1899c39b6', '76357f43-7569-4f17-a1ac-1cc05bc67bb0', '74ec1503-cddc-4e1a-841e-61fca46b9689', 'efba31be-95f0-42da-9da6-09a7e697e105'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:04 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:04 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Acquiring lock "cinder-8a4212da-8010-44bd-9ec2-d88b37995f40-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "cinder-8a4212da-8010-44bd-9ec2-d88b37995f40-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Acquiring lock "cinder-quobyte-8a4212da-8010-44bd-9ec2-d88b37995f40" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "cinder-quobyte-8a4212da-8010-44bd-9ec2-d88b37995f40" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd1cfc-9a94-4d6d-84db-be5d76b08d7e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:05 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 Jul 09 02:52:05 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:05 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.098s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:05 devstack cinder-volume[87156]: DEBUG cinder.manager [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Deleted volume successfully. Jul 09 02:52:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-aaadc314-e3b1-4fe4-a4c7-1d4228eede83 req-09a707c3-91d6-4552-977d-644fd5ef84bb tempest-VolumesSnapshotsTestJSON-186628452 None] Lock "cinder-b0fa9e37-fcd4-4dfd-8c08-78e04c268b13-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:06 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40" returned: 0 in 1.288s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:06 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40 Jul 09 02:52:06 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:07 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a4212da-8010-44bd-9ec2-d88b37995f40" returned: 0 in 0.991s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "cinder-quobyte-8a4212da-8010-44bd-9ec2-d88b37995f40" released by "delete_volume" :: held 2.373s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Created reservations ['5aaafba9-d102-465c-bd96-bb0bff45bb82', '101618e0-ca66-4460-b65a-f82e46a2f754', '68387688-b839-4a35-9b36-babbe864e48a', 'ceac76b2-3c24-49c7-8f51-721b021f4fd8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:07 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:07 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:08 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.812s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:08 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Deleted volume successfully. Jul 09 02:52:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7a0ec666-9c52-4428-bba3-0c955cb0cfdb tempest-AbsoluteLimitsTests-1341082146 None] Lock "cinder-8a4212da-8010-44bd-9ec2-d88b37995f40-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b81ed525-c5dd-480c-9788-7e782852d6f4 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" by "attach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b81ed525-c5dd-480c-9788-7e782852d6f4 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" acquired by "attach_volume" :: waited 0.041s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b81ed525-c5dd-480c-9788-7e782852d6f4 tempest-VolumesActionsTest-1887345895 None] Attaching volume de06abcf-a9e7-4a52-b83b-894fc29476b6 to instance 54e86c01-3d4b-4148-928f-367bf34454b5 at mountpoint /dev/vdb on host None. Jul 09 02:52:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b81ed525-c5dd-480c-9788-7e782852d6f4 tempest-VolumesActionsTest-1887345895 None] Attach volume completed successfully. Jul 09 02:52:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b81ed525-c5dd-480c-9788-7e782852d6f4 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" released by "attach_volume" :: held 0.233s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b057553a-2f49-4b5a-bf04-16f5cd009c38 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" by "detach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b057553a-2f49-4b5a-bf04-16f5cd009c38 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b057553a-2f49-4b5a-bf04-16f5cd009c38 tempest-VolumesActionsTest-1887345895 None] Detaching volume de06abcf-a9e7-4a52-b83b-894fc29476b6 from instance 54e86c01-3d4b-4148-928f-367bf34454b5. Jul 09 02:52:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b057553a-2f49-4b5a-bf04-16f5cd009c38 tempest-VolumesActionsTest-1887345895 None] Detach volume completed successfully. Jul 09 02:52:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b057553a-2f49-4b5a-bf04-16f5cd009c38 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Flow 'volume_create_manager' (d861540a-341a-4435-915b-9cab20e24e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ad9da-0f3c-4e71-89d0-d20f1540c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ad9da-0f3c-4e71-89d0-d20f1540c50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-682779363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbd3ade-16b8-4e5c-9816-628c0c86bb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4588969013f14eec85625537533352be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:12Z,use_quota=True,user_id='42ca0fb2eaad438784fd1dd4caa1c503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4cbb35-8338-4125-8ff0-4c26c82b26c6),volume_type_id=ad4cbb35-8338-4125-8ff0-4c26c82b26c6)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62536191-632b-4b6c-8965-02c04160f487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62536191-632b-4b6c-8965-02c04160f487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0336327-5340-4271-8387-46d683f9f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0336327-5340-4271-8387-46d683f9f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbd3ade-16b8-4e5c-9816-628c0c86bb49', 'volume_name': 'volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39e0806-8600-486a-92fa-d57c2b49e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39e0806-8600-486a-92fa-d57c2b49e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afdf69c-84c3-4117-a43d-fbb4be7c3705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Volume 6fbd3ade-16b8-4e5c-9816-628c0c86bb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49', 'volume_size': 1} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-682779363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbd3ade-16b8-4e5c-9816-628c0c86bb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4588969013f14eec85625537533352be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:12Z,use_quota=True,user_id='42ca0fb2eaad438784fd1dd4caa1c503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4cbb35-8338-4125-8ff0-4c26c82b26c6),volume_type_id=ad4cbb35-8338-4125-8ff0-4c26c82b26c6)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Creating volume 6fbd3ade-16b8-4e5c-9816-628c0c86bb49 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:12 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:12 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 1073741824 Jul 09 02:52:12 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:13 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 1073741824" returned: 0 in 1.180s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:13 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 Jul 09 02:52:13 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:14 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" returned: 0 in 0.942s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afdf69c-84c3-4117-a43d-fbb4be7c3705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3b72ca-c1bf-40b0-b5c4-c5211c11110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:14 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Volume volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 (6fbd3ade-16b8-4e5c-9816-628c0c86bb49): created successfully Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3b72ca-c1bf-40b0-b5c4-c5211c11110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Flow 'volume_create_manager' (d861540a-341a-4435-915b-9cab20e24e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-86705178-4ca6-478d-8c5e-9c086c19369f tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Created volume successfully. Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (cf032bd0-eb2c-477b-b79f-62f248803118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaef5f6c-125c-4566-9a89-e247f04aba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaef5f6c-125c-4566-9a89-e247f04aba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3888591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c36e055-545e-485c-a7e0-9ddd9b67802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9b726e9c844304970a0a206ff42a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:15Z,use_quota=True,user_id='af6b187cf7124db19a87b399ae2935df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd27d2-75dd-4db8-8c1c-12f1eb1fb7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd27d2-75dd-4db8-8c1c-12f1eb1fb7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c0daff-c055-409b-9267-5bf32392779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c0daff-c055-409b-9267-5bf32392779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c36e055-545e-485c-a7e0-9ddd9b67802d', 'volume_name': 'volume-9c36e055-545e-485c-a7e0-9ddd9b67802d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2463d54-0115-46d2-95ff-6c02e27fc72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2463d54-0115-46d2-95ff-6c02e27fc72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0455cd5c-3f4f-4014-8a75-998bd1842513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:15 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Volume 9c36e055-545e-485c-a7e0-9ddd9b67802d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c36e055-545e-485c-a7e0-9ddd9b67802d', 'volume_size': 1} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3888591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c36e055-545e-485c-a7e0-9ddd9b67802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9b726e9c844304970a0a206ff42a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:15Z,use_quota=True,user_id='af6b187cf7124db19a87b399ae2935df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Creating volume 9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:15 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:15 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d 1073741824 Jul 09 02:52:15 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:15 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:15 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:16 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d 1073741824" returned: 0 in 1.011s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:16 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:16 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:16 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.775s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3faa1bbf-9da2-4835-b07b-ebf4d688a9d4 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Retype volume completed successfully. Jul 09 02:52:16 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 0.732s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0455cd5c-3f4f-4014-8a75-998bd1842513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c36e055-545e-485c-a7e0-9ddd9b67802d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd6e3a3-4706-4f55-ab4c-4ac298783b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Volume volume-9c36e055-545e-485c-a7e0-9ddd9b67802d (9c36e055-545e-485c-a7e0-9ddd9b67802d): created successfully Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd6e3a3-4706-4f55-ab4c-4ac298783b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (cf032bd0-eb2c-477b-b79f-62f248803118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6e2249f9-0628-477c-a6ff-0394a36ba674 tempest-VolumesDeleteCascade-1715340726 None] Created volume successfully. Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "cinder-6fbd3ade-16b8-4e5c-9816-628c0c86bb49-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "cinder-6fbd3ade-16b8-4e5c-9816-628c0c86bb49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "cinder-quobyte-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "cinder-quobyte-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b4c6d-f3e2-4917-a9f2-e4d5acc995d2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:17 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 Jul 09 02:52:17 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-805c87fd-231f-449a-af98-0dad0f3784c6 tempest-BackendsCapabilitiesAdminTestsJSON-1552032414 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87156) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 02:52:17 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" returned: 0 in 0.772s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:18 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49 Jul 09 02:52:18 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Creating offline snapshot 25465aaa-2677-4b9b-84d5-0337143dfc18 of volume 9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cbf96c-f334-4a66-a7d8-dead308f33dd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9c7dbde0-35f0-40d3-a234-e389592d13c8 tempest-BackendsCapabilitiesAdminTestsJSON-1552032414 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87156) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 02:52:18 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:18 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:18 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "cinder-quobyte-6fbd3ade-16b8-4e5c-9816-628c0c86bb49" released by "delete_volume" :: held 1.562s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:18 devstack cinder-volume[87156]: WARNING cinder.quota [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:18 devstack cinder-volume[87156]: WARNING cinder.quota [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Created reservations ['3296ffb3-300f-4d37-9755-3413546a0dc8', 'ee77e268-06f4-47e4-bf88-16920d6cc084', '7b73ebe6-8f5f-4e8b-9e43-1a90757e82e0', 'ea77d6d2-ac13-4ac6-8822-691c64d10ecf'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:18 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:18 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:19 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 0.892s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:19 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 1G Jul 09 02:52:19 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:19 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.798s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:19 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Deleted volume successfully. Jul 09 02:52:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-68f01bc6-e7f4-4f48-86e6-2c2e8d91b1b2 tempest-VolumeRetypeWithoutMigrationTest-694080492 None] Lock "cinder-6fbd3ade-16b8-4e5c-9816-628c0c86bb49-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:20 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 1G" returned: 0 in 1.199s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:20 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:20 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:21 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 0.925s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:21 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 is being set with open permissions: ugo+rw Jul 09 02:52:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:21 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:21 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:22 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 0.828s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:22 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info Jul 09 02:52:22 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:23 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:23 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info is being set with open permissions: ugo+rw Jul 09 02:52:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:23 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info Jul 09 02:52:23 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:23 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.info" returned: 0 in 0.769s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.508s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-76d7c283-fb28-4111-9d88-d591b61b827d tempest-VolumesDeleteCascade-1715340726 None] Create snapshot completed successfully Jul 09 02:52:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Creating offline snapshot f9aaa843-046e-41bd-b90c-112130b55530 of volume 9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:52:25 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fc713-be98-470a-a98d-494304a04dab]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:25 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:25 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85a44856-874c-44ea-a952-26bf75477e55 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1081526070: creating Jul 09 02:52:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85a44856-874c-44ea-a952-26bf75477e55 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1081526070: created successfully Jul 09 02:52:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85a44856-874c-44ea-a952-26bf75477e55 tempest-GroupSnapshotsTest-225472218 None] Create group completed successfully. Jul 09 02:52:26 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 1.254s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c36e055-545e-485c-a7e0-9ddd9b67802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:26 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 1G Jul 09 02:52:26 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:27 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 1G" returned: 0 in 1.239s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:27 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:27 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (e44c2ab7-4444-4e46-a1f5-7a0e86957ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4758a025-7345-4709-91e2-1a012e0e4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4758a025-7345-4709-91e2-1a012e0e4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132647368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bec00dc3-d9ea-4a28-b708-c247e9bcf0c5,host='devstack@QuobyteHD#QuobyteHD',id=3302c899-528d-4419-9d64-cdd643fa7710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:27Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32393811-64f3-4c0b-946c-6b1065a0e339),volume_type_id=32393811-64f3-4c0b-946c-6b1065a0e339)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaa08c4-e886-438f-8688-6aa80df4ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaa08c4-e886-438f-8688-6aa80df4ac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662cc618-3413-44ff-849e-7eef31d06b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662cc618-3413-44ff-849e-7eef31d06b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3302c899-528d-4419-9d64-cdd643fa7710', 'volume_name': 'volume-3302c899-528d-4419-9d64-cdd643fa7710', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2327730-e566-4c7a-beea-875284cb3aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2327730-e566-4c7a-beea-875284cb3aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e24e28b-a189-4248-9b23-4393359cfe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Volume 3302c899-528d-4419-9d64-cdd643fa7710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3302c899-528d-4419-9d64-cdd643fa7710', 'volume_size': 1} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Flow 'volume_create_manager' (cc8401d9-3303-4975-8450-f60f6ef1441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6385a6f-31fe-4fde-9b31-cc1a0efedf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6385a6f-31fe-4fde-9b31-cc1a0efedf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1834571696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9451ab1540641f7810025450068420c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:28Z,use_quota=True,user_id='f283ba72c7264a738d86df6555048e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e4c64-d70b-405d-ab34-65cd9b20d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e4c64-d70b-405d-ab34-65cd9b20d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6377077-8097-4411-ab0e-b03bd7eb2fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6377077-8097-4411-ab0e-b03bd7eb2fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7', 'volume_name': 'volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad62147-c866-4933-9f6e-4d909d65917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad62147-c866-4933-9f6e-4d909d65917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3584dc-3be9-4889-bd6d-8fd0afd1d4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Volume cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7', 'volume_size': 1} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:27 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:27 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:28 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 0.699s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:28 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 is being set with open permissions: ugo+rw Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:28 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:28 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:28 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.770s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 8 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:52:28 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 0.684s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.997s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bec00dc3-d9ea-4a28-b708-c247e9bcf0c5,created_at=2026-07-09T00:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132647368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bec00dc3-d9ea-4a28-b708-c247e9bcf0c5,host='devstack@QuobyteHD#QuobyteHD',id=3302c899-528d-4419-9d64-cdd643fa7710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:27Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32393811-64f3-4c0b-946c-6b1065a0e339),volume_type_id=32393811-64f3-4c0b-946c-6b1065a0e339)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Creating volume 3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:28 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:28 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 1073741824 Jul 09 02:52:28 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d9a5d34d-7af6-482c-943d-67be3c0a01da tempest-VolumesDeleteCascade-1715340726 None] Create snapshot completed successfully Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-9c36e055-545e-485c-a7e0-9ddd9b67802d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-9c36e055-545e-485c-a7e0-9ddd9b67802d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Performing cascade delete. {{(pid=87156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-25465aaa-2677-4b9b-84d5-0337143dfc18-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-25465aaa-2677-4b9b-84d5-0337143dfc18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-25465aaa-2677-4b9b-84d5-0337143dfc18" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-25465aaa-2677-4b9b-84d5-0337143dfc18" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Deleting offline snapshot 25465aaa-2677-4b9b-84d5-0337143dfc18 of volume 9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] snapshot_file for this snap is: volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[07459b33-ff29-4cc0-a9fb-522e70e2e92f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:29 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:29 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:29 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 1073741824" returned: 0 in 0.876s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:29 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:52:29 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:30 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c36e055-545e-485c-a7e0-9ddd9b67802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57569d-4b9d-4004-80f6-75e7d2a5165a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:30 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.923s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1834571696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9451ab1540641f7810025450068420c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:28Z,use_quota=True,user_id='f283ba72c7264a738d86df6555048e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Creating volume cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:30 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e24e28b-a189-4248-9b23-4393359cfe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3302c899-528d-4419-9d64-cdd643fa7710', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:30 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 1073741824 Jul 09 02:52:30 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d00493-222c-4bc1-8c83-7e7baff7a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Volume volume-3302c899-528d-4419-9d64-cdd643fa7710 (3302c899-528d-4419-9d64-cdd643fa7710): created successfully Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d00493-222c-4bc1-8c83-7e7baff7a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (e44c2ab7-4444-4e46-a1f5-7a0e86957ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-86a8b3b2-69de-49c9-a2c3-4fc0b954dcd6 tempest-GroupSnapshotsTest-225472218 None] Created volume successfully. Jul 09 02:52:30 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:30 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] GroupSnapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: creating. Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Group snapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: creating. {{(pid=87156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:31 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 1.266s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d438b2a8-3809-4624-a160-beafadb2c714]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:31 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 1073741824" returned: 0 in 1.229s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:32 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 Jul 09 02:52:32 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:32 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:32 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:32 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" returned: 0 in 0.690s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.048s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:32 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Creating offline snapshot 001e4b64-e1b6-428e-8727-a8664013a68b of volume 3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3584dc-3be9-4889-bd6d-8fd0afd1d4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d44346-1414-4110-84d0-2f98f9512107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d9224-104d-4a13-a25d-b49ac8a50b05]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c36e055-545e-485c-a7e0-9ddd9b67802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:32 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Volume volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 (cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7): created successfully Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d44346-1414-4110-84d0-2f98f9512107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Flow 'volume_create_manager' (cc8401d9-3303-4975-8450-f60f6ef1441f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c414e28-2dcb-4295-bbb0-1de9a9420bc3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:32 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fb584f69-9afd-40fb-bc86-d31ed6467905 tempest-VolumesServicesTestJSON-604605578 None] Created volume successfully. Jul 09 02:52:32 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:52:32 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:32 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:32 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Acquiring lock "cinder-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "cinder-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Acquiring lock "cinder-quobyte-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "cinder-quobyte-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f657bd-ea32-4ba2-9c9f-42af467db209]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:33 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 Jul 09 02:52:33 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:33 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 1.002s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:33 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b 1G Jul 09 02:52:33 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:34 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 1.326s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c36e055-545e-485c-a7e0-9ddd9b67802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6a746-618e-4a98-b263-4c70d98a2bae]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:34 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:34 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:34 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" returned: 0 in 1.332s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:34 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7 Jul 09 02:52:34 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:34 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b 1G" returned: 0 in 1.202s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3302c899-528d-4419-9d64-cdd643fa7710 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:34 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3302c899-528d-4419-9d64-cdd643fa7710 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:34 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:35 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 1.142s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:35 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:35 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:35 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" returned: 0 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "cinder-quobyte-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7" released by "delete_volume" :: held 2.382s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:35 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3302c899-528d-4419-9d64-cdd643fa7710 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 0.915s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:35 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Created reservations ['5c7a4cd1-855c-4ca6-9b21-202ef7c5125f', '7a2f8654-1d97-405f-a9f1-461476691ffc', '47c87698-4c98-49e2-81aa-e5d2dace9eff', '1792a9a1-8def-469d-8b1c-66d04564fa5d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:35 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:35 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c7f87a6e-10f0-47f1-bec7-1a27e50fc4c4 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" by "attach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c7f87a6e-10f0-47f1-bec7-1a27e50fc4c4 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" acquired by "attach_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c7f87a6e-10f0-47f1-bec7-1a27e50fc4c4 tempest-VolumesActionsTest-1887345895 None] Attaching volume de06abcf-a9e7-4a52-b83b-894fc29476b6 to instance dc6a62d5-26ea-45b8-b90b-be9d54e8fce3 at mountpoint /dev/vdb on host None. Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:36 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c7f87a6e-10f0-47f1-bec7-1a27e50fc4c4 tempest-VolumesActionsTest-1887345895 None] Attach volume completed successfully. Jul 09 02:52:36 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c7f87a6e-10f0-47f1-bec7-1a27e50fc4c4 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6" released by "attach_volume" :: held 0.197s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:36 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 1.130s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:36 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18 Jul 09 02:52:36 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc161d7-cd2d-4dc1-8ff0-c853143bc169 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" by "detach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:36 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc161d7-cd2d-4dc1-8ff0-c853143bc169 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4fc161d7-cd2d-4dc1-8ff0-c853143bc169 tempest-VolumesActionsTest-1887345895 None] Detaching volume de06abcf-a9e7-4a52-b83b-894fc29476b6 from instance dc6a62d5-26ea-45b8-b90b-be9d54e8fce3. Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 0.902s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4fc161d7-cd2d-4dc1-8ff0-c853143bc169 tempest-VolumesActionsTest-1887345895 None] Detach volume completed successfully. Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc161d7-cd2d-4dc1-8ff0-c853143bc169 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:36 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info Jul 09 02:52:36 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:36 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.864s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:36 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Deleted volume successfully. Jul 09 02:52:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-11b9e028-fc77-43ce-9151-3f4149dc2892 tempest-VolumesServicesTestJSON-604605578 None] Lock "cinder-cbbb1d9c-cb4b-4cc8-9ea3-a1907ae88ab7-delete_volume" released by "delete_volume" :: held 3.729s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:37 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.25465aaa-2677-4b9b-84d5-0337143dfc18" returned: 0 in 1.095s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 -F qcow2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:37 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 -F qcow2 Jul 09 02:52:37 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:37 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info" returned: 0 in 0.859s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:37 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:52:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:37 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info Jul 09 02:52:37 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:38 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c36e055-545e-485c-a7e0-9ddd9b67802d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 -F qcow2" returned: 0 in 1.137s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-25465aaa-2677-4b9b-84d5-0337143dfc18" released by "_delete_snapshot" :: held 9.088s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" released by "delete_snapshot" :: held 9.117s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:38 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.info" returned: 0 in 1.045s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.053s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['47d7e3b2-d7f0-4a98-a258-165d5eb3773a', '50a60a15-705d-4c42-b1e2-02f56480b26e', '28c2df5d-07be-4a08-8aaa-b0715a02eb9f', '7ba44073-cf9d-4989-89a5-c83197708419'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9cbe130f-ff71-4295-b445-9c8f1c3dc52a tempest-GroupSnapshotsTest-225472218 None] group_snapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: created successfully Jul 09 02:52:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Delete snapshot completed successfully. Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-25465aaa-2677-4b9b-84d5-0337143dfc18-delete_snapshot" released by "delete_snapshot" :: held 9.360s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-f9aaa843-046e-41bd-b90c-112130b55530-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-f9aaa843-046e-41bd-b90c-112130b55530-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-f9aaa843-046e-41bd-b90c-112130b55530" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-f9aaa843-046e-41bd-b90c-112130b55530" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Deleting offline snapshot f9aaa843-046e-41bd-b90c-112130b55530 of volume 9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:52:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] snapshot_file for this snap is: volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:52:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c436c-021e-45ba-aeed-ded85ca56a0e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:39 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:39 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:40 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 1.029s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c36e055-545e-485c-a7e0-9ddd9b67802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[22932563-0f08-49b2-a8eb-43e8fcfae0f7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:40 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:40 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b-abc09164-8f79-49e6-9949-980f16c32b1e" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b-abc09164-8f79-49e6-9949-980f16c32b1e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Creating volume abc09164-8f79-49e6-9949-980f16c32b1e from snapshot 001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] snapshot: 001e4b64-e1b6-428e-8727-a8664013a68b, volume: abc09164-8f79-49e6-9949-980f16c32b1e, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ca8f0-d8e6-4eee-948b-4f14515b3122]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:40 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:40 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:41 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 1.195s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:41 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:41 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:41 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 1.152s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3302c899-528d-4419-9d64-cdd643fa7710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc45296-57e7-449c-833a-8bf15915b14d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:41 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:52:41 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:42 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 0.824s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:42 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530 Jul 09 02:52:42 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:42 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:42 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e Jul 09 02:52:42 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:42 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d.f9aaa843-046e-41bd-b90c-112130b55530" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-f9aaa843-046e-41bd-b90c-112130b55530" released by "_delete_snapshot" :: held 3.925s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" released by "delete_snapshot" :: held 3.949s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:42 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['4b41aa57-6382-4e4e-be67-6149f8271b51', '31bc8218-efb1-4e33-9f13-586493b3dc7e', '89499842-3b0a-4844-99e5-6b15c5a735b7', '8465e95b-ff1f-4fe3-a021-95789891a440'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Delete snapshot completed successfully. Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-f9aaa843-046e-41bd-b90c-112130b55530-delete_snapshot" released by "delete_snapshot" :: held 4.138s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Snapshots deleted, issuing volume delete {{(pid=87156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a721c02-44a6-4df4-86d5-f0507319b46f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:43 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:43 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:44 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 1.344s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:44 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d Jul 09 02:52:44 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:46 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9c36e055-545e-485c-a7e0-9ddd9b67802d" returned: 0 in 1.548s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-9c36e055-545e-485c-a7e0-9ddd9b67802d" released by "delete_volume" :: held 3.030s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['0ed5f06f-ca96-4237-a237-9c5bbb910d78', '89911c92-707c-42fb-a82a-bd83ffba86ad', '44e30a5f-bad0-4935-a6ab-b007535ad452', '56b2ec40-8a7f-4db8-8b67-79ffa5af1fc7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:46 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:46 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Flow 'volume_create_manager' (9696b3c5-c9a2-4971-95b9-80d31530cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a152fb-c5d1-4506-a6f9-3491227e1657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a152fb-c5d1-4506-a6f9-3491227e1657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1419779795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6760c5-24e6-4f22-ac69-1edb2b39d000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a22518e643485fad73e2bdefc23fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:47Z,use_quota=True,user_id='0cea56de229742c19e84500aea12295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32cd831a-656a-4f40-ad3f-9c72b1ef9f04),volume_type_id=32cd831a-656a-4f40-ad3f-9c72b1ef9f04)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e42ab0f-66fc-42ff-a0b1-415004580d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e42ab0f-66fc-42ff-a0b1-415004580d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e8c08-07fe-4ed8-b932-d22e98398e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e8c08-07fe-4ed8-b932-d22e98398e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6760c5-24e6-4f22-ac69-1edb2b39d000', 'volume_name': 'volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f34f780-b49f-44e2-a084-cf25801b245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f34f780-b49f-44e2-a084-cf25801b245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d07bfd-40c9-48ef-bb5d-58ecc83dd7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:47 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Volume 4e6760c5-24e6-4f22-ac69-1edb2b39d000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000', 'volume_size': 1} Jul 09 02:52:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:48 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.596s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Deleted volume successfully. Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d146c644-a691-489f-b38c-5917b64989da tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-9c36e055-545e-485c-a7e0-9ddd9b67802d-delete_volume" released by "delete_volume" :: held 18.933s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e" returned: 0 in 6.293s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba4c4f-c923-4fb8-900a-08fbeb37a83d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:52:48 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:52:48 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (dd094cd2-9a15-4643-b570-0a36db36b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a0772e-8efe-4588-bdbb-23d054b12219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a0772e-8efe-4588-bdbb-23d054b12219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1331505551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fa941c-5022-4614-90a7-bf4252c2b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9b726e9c844304970a0a206ff42a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:49Z,use_quota=True,user_id='af6b187cf7124db19a87b399ae2935df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa08239-51ef-4447-a879-7b2aae41a1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa08239-51ef-4447-a879-7b2aae41a1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0f6cbc-b740-4d51-9db0-0f2d0ff50593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0f6cbc-b740-4d51-9db0-0f2d0ff50593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fa941c-5022-4614-90a7-bf4252c2b3d9', 'volume_name': 'volume-43fa941c-5022-4614-90a7-bf4252c2b3d9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d57d90e-3f03-400e-a4cc-7ccfbff18e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d57d90e-3f03-400e-a4cc-7ccfbff18e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe03f2fd-d686-44d8-8781-271588a32900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Volume 43fa941c-5022-4614-90a7-bf4252c2b3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fa941c-5022-4614-90a7-bf4252c2b3d9', 'volume_size': 1} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:49 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 1.044s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:52:49 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Converted 1024.00 MB image at 162.66 MB/s Jul 09 02:52:49 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:52:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:49 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e Jul 09 02:52:49 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:50 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e" returned: 0 in 0.610s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" released by "_copy_volume_from_snapshot" :: held 10.094s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b-abc09164-8f79-49e6-9949-980f16c32b1e" released by "_create_volume_from_snapshot" :: held 10.134s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.153s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.783s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1419779795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6760c5-24e6-4f22-ac69-1edb2b39d000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a22518e643485fad73e2bdefc23fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:47Z,use_quota=True,user_id='0cea56de229742c19e84500aea12295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32cd831a-656a-4f40-ad3f-9c72b1ef9f04),volume_type_id=32cd831a-656a-4f40-ad3f-9c72b1ef9f04)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Creating volume 4e6760c5-24e6-4f22-ac69-1edb2b39d000 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:50 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 1073741824 Jul 09 02:52:50 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4c22e86d-e7e2-49c8-9273-dec3d81a6dba tempest-GroupSnapshotsTest-225472218 None] Create group from source-snapshot-3528fde2-d1bc-4acc-a740-4385fb6b9b27 completed successfully. Jul 09 02:52:51 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 1073741824" returned: 0 in 0.866s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:51 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 Jul 09 02:52:51 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a30e2-4346-4f39-9747-7472328673fc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:51 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e Jul 09 02:52:51 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:52 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.081s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1331505551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fa941c-5022-4614-90a7-bf4252c2b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9b726e9c844304970a0a206ff42a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:52:49Z,use_quota=True,user_id='af6b187cf7124db19a87b399ae2935df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Creating volume 43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:52:52 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d07bfd-40c9-48ef-bb5d-58ecc83dd7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:52 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 1073741824 Jul 09 02:52:52 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1faf33-43e4-41f0-abf3-30a4c88ad78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Volume volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 (4e6760c5-24e6-4f22-ac69-1edb2b39d000): created successfully Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1faf33-43e4-41f0-abf3-30a4c88ad78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Flow 'volume_create_manager' (9696b3c5-c9a2-4971-95b9-80d31530cdde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e70e3c0d-997f-4af7-a747-65bec7707f4b tempest-VolumeTypesAccessTest-196514163 None] Created volume successfully. Jul 09 02:52:52 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e" returned: 0 in 0.772s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:52 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e Jul 09 02:52:52 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:53 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 1073741824" returned: 0 in 0.895s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:53 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:52:53 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:53 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-abc09164-8f79-49e6-9949-980f16c32b1e" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-abc09164-8f79-49e6-9949-980f16c32b1e" released by "delete_volume" :: held 1.541s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Acquiring lock "cinder-4e6760c5-24e6-4f22-ac69-1edb2b39d000-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "cinder-4e6760c5-24e6-4f22-ac69-1edb2b39d000-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Acquiring lock "cinder-quobyte-4e6760c5-24e6-4f22-ac69-1edb2b39d000" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['3645613a-2afa-4e6f-b6ad-338af2b3edef'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "cinder-quobyte-4e6760c5-24e6-4f22-ac69-1edb2b39d000" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[62853061-3eb2-4f23-b730-0673b8aa4cfd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:53 devstack cinder-volume[87156]: WARNING cinder.quota [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1941074011 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1941074011, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:53 devstack cinder-volume[87156]: WARNING cinder.quota [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1941074011 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1941074011, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['52baae55-00e0-4f4e-8950-5102998c3217', '6c2909a2-6633-41d9-b1a4-5aeb9dd311a7', 'e53f85e1-d7f8-449e-ad7a-e02aafaa7b77', '74836028-2a12-4578-8cbe-92a6ae65ce5a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:53 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 Jul 09 02:52:53 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:53 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:53 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:53 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.739s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.428s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe03f2fd-d686-44d8-8781-271588a32900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fa941c-5022-4614-90a7-bf4252c2b3d9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd69dc07-68a4-4079-8002-4e9ca7d96e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a4da3-2e1b-471b-a871-0d2cf56803ef]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Volume volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 (43fa941c-5022-4614-90a7-bf4252c2b3d9): created successfully Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd69dc07-68a4-4079-8002-4e9ca7d96e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:52:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (dd094cd2-9a15-4643-b570-0a36db36b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:52:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f25344bb-dc99-4560-a218-522408737122 tempest-VolumesDeleteCascade-1715340726 None] Created volume successfully. Jul 09 02:52:53 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:52:53 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] group_snapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: deleting Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] group_snapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: deleting {{(pid=87156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Deleting offline snapshot 001e4b64-e1b6-428e-8727-a8664013a68b of volume 3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] snapshot_file for this snap is: volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cdd959-baf3-4ee6-9ddc-6c8e787d61b3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:54 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.908s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:54 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000" returned: 0 in 1.079s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f293731e-368c-4f82-8015-f2fb332fdd72 tempest-GroupSnapshotsTest-225472218 None] Delete group completed successfully. Jul 09 02:52:54 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000 Jul 09 02:52:54 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:54 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:54 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:54 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.978s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5decc2-fd2f-4db6-ad13-372517951b00]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:54 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:52:54 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:55 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e6760c5-24e6-4f22-ac69-1edb2b39d000" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "cinder-quobyte-4e6760c5-24e6-4f22-ac69-1edb2b39d000" released by "delete_volume" :: held 1.881s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:55 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1611168968 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1611168968, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:55 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1611168968 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1611168968, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Created reservations ['abfeb306-17b8-4173-9fad-f77aa26ec5cd', 'f3946078-c508-4aa4-8d22-84f867fbfd34', '1a4f577f-e916-4599-b853-8d5442f1fcd7', 'e37f68c3-2995-4a3b-a321-fedd7c461727'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:52:55 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 0.901s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3302c899-528d-4419-9d64-cdd643fa7710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb3b45e-7858-4829-b796-dc6c0550e309]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:55 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:52:55 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:55 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:52:55 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:55 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.f4d5df02-458d-400d-b821-487820d5da09bajwlphe.img {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:55 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.f4d5df02-458d-400d-b821-487820d5da09bajwlphe.img Jul 09 02:52:55 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:56 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.690s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:56 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:52:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Deleted volume successfully. Jul 09 02:52:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d0f350e9-8650-491f-9a6b-d32ebf32bb49 tempest-VolumeTypesAccessTest-196514163 None] Lock "cinder-4e6760c5-24e6-4f22-ac69-1edb2b39d000-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:52:56 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 0.932s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:56 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:56 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:52:57 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 09 02:52:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 1.762s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:52:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:52:58 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b Jul 09 02:52:58 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:00 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710.001e4b64-e1b6-428e-8727-a8664013a68b" returned: 0 in 2.086s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-001e4b64-e1b6-428e-8727-a8664013a68b" released by "_delete_snapshot" :: held 5.863s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" released by "delete_snapshot" :: held 5.918s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:00 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1941074011 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1941074011, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] Created reservations ['c1140ff3-9962-4713-a32e-8cf8a10dea48', '3bb337fc-9c72-46a9-8e4e-d9dae53639d2', '7bd58d52-2e23-48df-8526-0bba992d6bd2', '6fd79329-90e8-43b1-bc0d-9eb098377b76'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:00 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d8d25908-f7f5-491b-8a51-7842c8d1359e tempest-GroupSnapshotsTest-225472218 None] group_snapshot 3528fde2-d1bc-4acc-a740-4385fb6b9b27: deleted successfully Jul 09 02:53:00 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.f4d5df02-458d-400d-b821-487820d5da09bajwlphe.img" returned: 0 in 5.297s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba3b04c-488a-4a6d-b531-61f679bae7fa]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:01 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:01 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca5cb5-beb4-46de-9db9-70ec440a4aed]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:01 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:53:01 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:02 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 1.075s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.f4d5df02-458d-400d-b821-487820d5da09bajwlphe.img {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:53:02 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Converted 1024.00 MB image at 193.30 MB/s Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=119,cinder:INSERT=27,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=120,cinder:DELETE=9 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] f4d5df02-458d-400d-b821-487820d5da09 was raw, no need to convert to raw {{(pid=87156) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 02:53:02 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 0.907s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:02 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710 Jul 09 02:53:02 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:02 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3302c899-528d-4419-9d64-cdd643fa7710" returned: 0 in 0.717s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-3302c899-528d-4419-9d64-cdd643fa7710" released by "delete_volume" :: held 1.700s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['129be904-7594-40d6-af7b-528ddd3dbbcc'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:03 devstack cinder-volume[87156]: WARNING cinder.db.api [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1941074011'] Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['3b91ce76-2a23-4ee5-ab96-cc73247e5747', '010c69dd-950d-4f27-b52c-f2340e0208e8', '199169c7-2ecf-4448-aebe-2dceb472214a', '199c48a9-60a5-4d04-b709-654da93d0f06'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:03 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:53:03 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:04 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.784s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:04 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:53:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9d7594f7-6c3c-43a6-bdf0-575b3c879990 tempest-GroupSnapshotsTest-225472218 None] Delete group completed successfully. Jul 09 02:53:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34dc03bb-0571-4a44-a3be-aba41fd27020 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1323753384: creating Jul 09 02:53:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34dc03bb-0571-4a44-a3be-aba41fd27020 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1323753384: created successfully Jul 09 02:53:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34dc03bb-0571-4a44-a3be-aba41fd27020 tempest-GroupSnapshotsTest-225472218 None] Create group completed successfully. Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (f5d61c18-09e4-4e8a-b43a-89d576f74329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad760267-a898-4e5a-accf-95a3f8adf549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad760267-a898-4e5a-accf-95a3f8adf549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799043327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,host='devstack@QuobyteHD#QuobyteHD',id=edbf285f-24a3-4a60-bc49-a966955e18e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:06Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8532f2-41d4-49f7-87c2-5beed0df83a9),volume_type_id=0d8532f2-41d4-49f7-87c2-5beed0df83a9)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474b142f-7bbe-42fc-9eb5-96ee89d5c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474b142f-7bbe-42fc-9eb5-96ee89d5c96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e721ac0-32de-40cb-b6f8-ae59ec82cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e721ac0-32de-40cb-b6f8-ae59ec82cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbf285f-24a3-4a60-bc49-a966955e18e5', 'volume_name': 'volume-edbf285f-24a3-4a60-bc49-a966955e18e5', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88076d2-e431-4f18-88da-1e2a824af312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88076d2-e431-4f18-88da-1e2a824af312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e10221e-fdc3-460c-8c59-6bc6254fa52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:06 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Volume edbf285f-24a3-4a60-bc49-a966955e18e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbf285f-24a3-4a60-bc49-a966955e18e5', 'volume_size': 1} Jul 09 02:53:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Flow 'volume_create_manager' (53112a4d-c223-424a-abde-a16022d0896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4202785-2bfe-4058-92ad-12ca6952259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4202785-2bfe-4058-92ad-12ca6952259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1822771350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc4739-38bb-4252-8eaf-24edc1f7969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b813d1ee56413a8d1e5f5f639a4739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:16Z,use_quota=True,user_id='e372afec54b74c44a420e65051992423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73d9c69-1637-49a2-a266-5855c96764f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73d9c69-1637-49a2-a266-5855c96764f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a2257a-6c0f-4b68-a846-4244165d6438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a2257a-6c0f-4b68-a846-4244165d6438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdc4739-38bb-4252-8eaf-24edc1f7969c', 'volume_name': 'volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb8679-54f5-4898-bce5-1c7a6cb99f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb8679-54f5-4898-bce5-1c7a6cb99f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b8c683-4f27-4d2f-8e3e-8ebc7e9e8601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:15 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Volume 5bdc4739-38bb-4252-8eaf-24edc1f7969c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c', 'volume_size': 1} Jul 09 02:53:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.390s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Uploaded volume to glance image-id: f4d5df02-458d-400d-b821-487820d5da09. {{(pid=87156) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.498s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Creating offline snapshot ecfbeef4-578f-4a6e-8346-40767e429e4b of volume 43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:53:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cdaffa56-8e0c-4442-bc13-bddf9e822e0d tempest-VolumesActionsTest-1887345895 None] Copy volume to image completed successfully. Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[594f045b-7103-49a3-a62a-29c8447e3e06]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:23 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:23 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:24 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.832s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:24 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b 1G Jul 09 02:53:24 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:24 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b 1G" returned: 0 in 0.803s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:24 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:24 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:25 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:25 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b is being set with open permissions: ugo+rw Jul 09 02:53:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:25 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:25 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:26 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.634s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:26 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info Jul 09 02:53:26 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:26 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info" returned: 0 in 0.635s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:26 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info is being set with open permissions: ugo+rw Jul 09 02:53:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:26 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info Jul 09 02:53:26 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:27 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.info" returned: 0 in 0.616s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.370s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,created_at=2026-07-09T00:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799043327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,host='devstack@QuobyteHD#QuobyteHD',id=edbf285f-24a3-4a60-bc49-a966955e18e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:06Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8532f2-41d4-49f7-87c2-5beed0df83a9),volume_type_id=0d8532f2-41d4-49f7-87c2-5beed0df83a9)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Creating volume edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:53:27 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:27 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 1073741824 Jul 09 02:53:27 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-de8c0d9e-d902-441f-803d-6c62ffaf0dbd tempest-VolumesDeleteCascade-1715340726 None] Create snapshot completed successfully Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:27 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:53:27 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:28 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 1073741824" returned: 0 in 0.919s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:28 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 Jul 09 02:53:28 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:28 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (cd425426-20c8-4271-81b2-2cc12e5eff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02857c3a-7189-4f53-8b9e-1889e834f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02857c3a-7189-4f53-8b9e-1889e834f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-40150167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9b726e9c844304970a0a206ff42a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecfbeef4-578f-4a6e-8346-40767e429e4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:29Z,use_quota=True,user_id='af6b187cf7124db19a87b399ae2935df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d416932-1764-436a-a794-4a517e312b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d416932-1764-436a-a794-4a517e312b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea2b4f4-4fbf-440a-90f4-a16185c084ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea2b4f4-4fbf-440a-90f4-a16185c084ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca', 'volume_name': 'volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca', 'volume_size': 1, 'snapshot_id': 'ecfbeef4-578f-4a6e-8346-40767e429e4b'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb552646-dcd3-4a3a-957c-e45698042d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb552646-dcd3-4a3a-957c-e45698042d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671d7f7c-6b15-417c-bb20-21b1f9df1683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Volume 7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca', 'volume_size': 1, 'snapshot_id': 'ecfbeef4-578f-4a6e-8346-40767e429e4b'} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:29 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5" returned: 0 in 0.683s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.453s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1822771350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdc4739-38bb-4252-8eaf-24edc1f7969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b813d1ee56413a8d1e5f5f639a4739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:16Z,use_quota=True,user_id='e372afec54b74c44a420e65051992423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Creating volume 5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:53:29 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:29 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c 1073741824 Jul 09 02:53:29 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e10221e-fdc3-460c-8c59-6bc6254fa52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbf285f-24a3-4a60-bc49-a966955e18e5', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644dd9dc-e057-463e-9fa9-9c015d819d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Volume volume-edbf285f-24a3-4a60-bc49-a966955e18e5 (edbf285f-24a3-4a60-bc49-a966955e18e5): created successfully Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644dd9dc-e057-463e-9fa9-9c015d819d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (f5d61c18-09e4-4e8a-b43a-89d576f74329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b8e2bc88-3c1f-4ea3-8135-611476b435a8 tempest-GroupSnapshotsTest-225472218 None] Created volume successfully. Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (53ffd4a9-1c2c-4385-91b2-1ecb96a9933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94daa9a8-fee4-463c-8bbf-f3a6b1f7391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94daa9a8-fee4-463c-8bbf-f3a6b1f7391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2048855810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,host='devstack@QuobyteHD#QuobyteHD',id=87977ba0-a3a4-4b26-9e3e-7d0214657b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:30Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8532f2-41d4-49f7-87c2-5beed0df83a9),volume_type_id=0d8532f2-41d4-49f7-87c2-5beed0df83a9)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1bad85-a8ae-4d55-8ca7-b4df5fafb94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1bad85-a8ae-4d55-8ca7-b4df5fafb94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93100395-f145-43cf-b7ae-40ac87c02c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93100395-f145-43cf-b7ae-40ac87c02c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87977ba0-a3a4-4b26-9e3e-7d0214657b2d', 'volume_name': 'volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ea6cc-ac44-4471-acf3-fc3b58d4f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ea6cc-ac44-4471-acf3-fc3b58d4f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98471686-e846-4540-9b2b-c78c7b07c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Volume 87977ba0-a3a4-4b26-9e3e-7d0214657b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d', 'volume_size': 1} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c 1073741824" returned: 0 in 0.940s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:30 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c Jul 09 02:53:30 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:30 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c" returned: 0 in 0.643s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b8c683-4f27-4d2f-8e3e-8ebc7e9e8601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a8b97-c655-408e-8394-d224c21c17fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[984fdda6-e355-49da-97e5-6e6e714473c0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Volume volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c (5bdc4739-38bb-4252-8eaf-24edc1f7969c): created successfully Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a8b97-c655-408e-8394-d224c21c17fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Flow 'volume_create_manager' (53112a4d-c223-424a-abde-a16022d0896e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-aea6ce4d-f8e1-4e47-8d44-384a97e81ebd tempest-SnapshotMetadataTestJSON-1812253920 None] Created volume successfully. Jul 09 02:53:30 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:30 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:31 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.765s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7abac-5c7d-4da4-91df-74bb0e171b5c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:31 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:31 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:32 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.757s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:32 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img Jul 09 02:53:32 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:36 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img" returned: 0 in 4.375s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a71a7e-98d2-43d6-9d02-fad159718a62]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:36 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:36 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:37 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.966s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:37 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:53:37 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Converted 1024.00 MB image at 233.99 MB/s Jul 09 02:53:37 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] 7d7dbd7a-f953-4858-9734-836330fd9980 was raw, converting to qcow2 {{(pid=87156) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 02:53:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ea46f-68b3-4f24-83e1-945f7193c279]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:37 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img Jul 09 02:53:37 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:38 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:38 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img Jul 09 02:53:38 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:39 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img" returned: 1 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img /opt/stack/data/cinder/conversion/vol_upload_87753iwk {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:39 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img /opt/stack/data/cinder/conversion/vol_upload_87753iwk Jul 09 02:53:39 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:39 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img /opt/stack/data/cinder/conversion/vol_upload_87753iwk" returned: 0 in 0.677s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Image conversion details: src /opt/stack/data/cinder/conversion/de06abcf-a9e7-4a52-b83b-894fc29476b6.temp_image.7d7dbd7a-f953-4858-9734-836330fd99802llh4_am.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_87753iwk {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:53:39 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[41121af9-3521-4fa7-9d85-94a562a45101]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_87753iwk {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:40 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_87753iwk Jul 09 02:53:40 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:40 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_87753iwk" returned: 0 in 0.733s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.166s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Uploaded volume to glance image-id: 7d7dbd7a-f953-4858-9734-836330fd9980. {{(pid=87156) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.939s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Creating volume 7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca from snapshot ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-dd1af086-7db0-4095-a88f-57dcf0bd9df8 tempest-VolumesActionsTest-1887345895 None] Copy volume to image completed successfully. Jul 09 02:53:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] snapshot: ecfbeef4-578f-4a6e-8346-40767e429e4b, volume: 7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[023cc856-e24e-4aee-b652-d1a3c67e3d18]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:42 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:42 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:42 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fa941c-5022-4614-90a7-bf4252c2b3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd530b83-3943-47cc-ae44-02297aa145a3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:42 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:42 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "cinder-quobyte-de06abcf-a9e7-4a52-b83b-894fc29476b6" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-quobyte-de06abcf-a9e7-4a52-b83b-894fc29476b6" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f798c25f-9497-4919-9ae8-136894e45fd8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:43 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:43 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:43 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.815s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:53:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:43 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca Jul 09 02:53:43 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:44 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 0.784s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:44 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6 Jul 09 02:53:44 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:45 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-de06abcf-a9e7-4a52-b83b-894fc29476b6" returned: 0 in 1.077s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-quobyte-de06abcf-a9e7-4a52-b83b-894fc29476b6" released by "delete_volume" :: held 1.916s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Created reservations ['ffe81436-5524-46d0-8a45-032700ca3c72', '2aa2aa76-8d8b-407b-aa59-f82acd2499f5', '1fbdab5e-7500-4d45-b46e-0bde46aebf91', '18a8fa9b-a1f7-443f-adbb-7115ba6b8de3'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:45 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:53:45 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:47 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.568s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:47 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:53:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Deleted volume successfully. Jul 09 02:53:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b9d0b152-c610-4024-8016-bb92f26bb308 tempest-VolumesActionsTest-1887345895 None] Lock "cinder-de06abcf-a9e7-4a52-b83b-894fc29476b6-delete_volume" released by "delete_volume" :: held 4.108s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:48 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" returned: 0 in 5.137s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9accc80-bedd-41ca-b286-eaa864a1bceb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:48 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:48 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:49 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 1.011s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:49 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:53:49 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Converted 1024.00 MB image at 199.31 MB/s Jul 09 02:53:49 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca is being set with open permissions: ugo+rw Jul 09 02:53:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:49 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca Jul 09 02:53:49 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:50 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" released by "_copy_volume_from_snapshot" :: held 8.522s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" released by "_create_volume_from_snapshot" :: held 8.552s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.577s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.426s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,created_at=2026-07-09T00:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2048855810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd4c3cd9-faf9-4187-8a51-ba030fe90400,host='devstack@QuobyteHD#QuobyteHD',id=87977ba0-a3a4-4b26-9e3e-7d0214657b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:30Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8532f2-41d4-49f7-87c2-5beed0df83a9),volume_type_id=0d8532f2-41d4-49f7-87c2-5beed0df83a9)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Creating volume 87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:53:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:50 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d 1073741824 Jul 09 02:53:50 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671d7f7c-6b15-417c-bb20-21b1f9df1683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca', 'volume_size': 1, 'snapshot_id': 'ecfbeef4-578f-4a6e-8346-40767e429e4b'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5d0e34-f3ba-4df0-8f61-22aca6590359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Volume volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca (7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca): created successfully Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5d0e34-f3ba-4df0-8f61-22aca6590359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Flow 'volume_create_manager' (cd425426-20c8-4271-81b2-2cc12e5eff5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cd1bc6b7-085e-41ca-8845-f644530d2a4f tempest-VolumesDeleteCascade-1715340726 None] Created volume successfully. Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-43fa941c-5022-4614-90a7-bf4252c2b3d9-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-43fa941c-5022-4614-90a7-bf4252c2b3d9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Performing cascade delete. {{(pid=87156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-ecfbeef4-578f-4a6e-8346-40767e429e4b-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-ecfbeef4-578f-4a6e-8346-40767e429e4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Deleting offline snapshot ecfbeef4-578f-4a6e-8346-40767e429e4b of volume 43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] snapshot_file for this snap is: volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45bd00f-5a97-4e05-9cbf-889a84d5187f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:51 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:51 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:51 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d 1073741824" returned: 0 in 1.063s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:51 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d Jul 09 02:53:51 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:52 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.891s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fa941c-5022-4614-90a7-bf4252c2b3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d933881-5c7a-4f50-87e2-a1a691196e1b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:52 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:52 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:52 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" returned: 0 in 0.786s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.634s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98471686-e846-4540-9b2b-c78c7b07c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bebf0d-ef37-4982-b6e5-1835c486d606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Creating offline snapshot f63df940-244d-43f8-a549-c381ad0a917c of volume 5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:53:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Volume volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d (87977ba0-a3a4-4b26-9e3e-7d0214657b2d): created successfully Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bebf0d-ef37-4982-b6e5-1835c486d606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (53ffd4a9-1c2c-4385-91b2-1ecb96a9933a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b957de-e605-4eff-bf62-f00b91cc0ca1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ab0ab28f-436e-4d63-a3c9-461d23d2bc53 tempest-GroupSnapshotsTest-225472218 None] Created volume successfully. Jul 09 02:53:52 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c Jul 09 02:53:52 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:52 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.816s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:52 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:52 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:53 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c" returned: 0 in 0.948s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:53 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c 1G Jul 09 02:53:53 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e8803d47-146a-4d06-be16-819c87cb8f30 tempest-GroupSnapshotsTest-225472218 None] Update group completed successfully. Jul 09 02:53:53 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.820s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:53 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b Jul 09 02:53:53 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:54 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c 1G" returned: 0 in 0.892s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:54 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9.ecfbeef4-578f-4a6e-8346-40767e429e4b" returned: 0 in 0.642s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:54 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c Jul 09 02:53:54 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-ecfbeef4-578f-4a6e-8346-40767e429e4b" released by "_delete_snapshot" :: held 3.304s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" released by "delete_snapshot" :: held 3.333s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['8ac9c063-dc60-47e1-9925-11ad73704409', '005a2914-60bf-4ada-8c90-b756a30a52d6', '37d674ed-7dad-4e79-86f5-17a2d4c18b4d', '684e51a1-2e08-4571-8a81-49c2429bc1e0'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Delete snapshot completed successfully. Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-ecfbeef4-578f-4a6e-8346-40767e429e4b-delete_snapshot" released by "delete_snapshot" :: held 3.609s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Snapshots deleted, issuing volume delete {{(pid=87156) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fc0d0-472e-4ee5-b4fc-0eec4fc1d0b2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c9acc8aa-c4fb-4392-bc8b-695ab688552d tempest-GroupSnapshotsTest-225472218 None] Update group completed successfully. Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (a55f1658-f084-486a-a3b3-8ae441a9a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:54 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:54 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037e5ac-134b-4325-8749-68fe098467c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037e5ac-134b-4325-8749-68fe098467c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2108430100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4064c8bc-1b98-4ea1-a8bf-a7705d035859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:55Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16f76a2-97ab-44bc-b441-b238640c3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16f76a2-97ab-44bc-b441-b238640c3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfee4b0-d5d9-42e0-ae3d-5a1ec117ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfee4b0-d5d9-42e0-ae3d-5a1ec117ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4064c8bc-1b98-4ea1-a8bf-a7705d035859', 'volume_name': 'volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838618d0-01d7-433d-8b8f-c7588aee9d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838618d0-01d7-433d-8b8f-c7588aee9d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e786e39e-9692-4039-a24f-16952ac22c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Volume 4064c8bc-1b98-4ea1-a8bf-a7705d035859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859', 'volume_size': 1} Jul 09 02:53:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:55 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c" returned: 0 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:55 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c is being set with open permissions: ugo+rw Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:55 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c Jul 09 02:53:55 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:55 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:55 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9 Jul 09 02:53:55 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:55 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c" returned: 0 in 0.607s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:55 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info Jul 09 02:53:55 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4f9b37e0-8b19-455d-bcd8-540c06774574 tempest-GroupSnapshotsTest-225472218 None] Update group completed successfully. Jul 09 02:53:56 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-43fa941c-5022-4614-90a7-bf4252c2b3d9" returned: 0 in 0.696s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-43fa941c-5022-4614-90a7-bf4252c2b3d9" released by "delete_volume" :: held 1.565s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['06f7a13c-c8fd-42f6-b4d6-483e987f2c65', '863c08a2-a6f2-44ff-aea3-dbb9675e5355', '423945b1-e789-4103-83c8-c9940d74028a', 'fdd47c0a-1478-4d96-8ff7-9977284841b2'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:56 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:53:56 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:56 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info" returned: 0 in 0.674s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:56 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info is being set with open permissions: ugo+rw Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:56 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info Jul 09 02:53:56 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd980d81-ceef-486e-99ca-ecb7997d09a1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:56 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca Jul 09 02:53:56 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:57 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.728s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:53:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Deleted volume successfully. Jul 09 02:53:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-70bb961d-9985-47e4-bb10-c0d8da1cc64e tempest-GroupSnapshotsTest-225472218 None] Update group completed successfully. Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-17810bfd-2848-4c24-9752-c7bb9c37e49e tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-43fa941c-5022-4614-90a7-bf4252c2b3d9-delete_volume" released by "delete_volume" :: held 6.238s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:57 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.info" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.814s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2108430100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4064c8bc-1b98-4ea1-a8bf-a7705d035859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:53:55Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Creating volume 4064c8bc-1b98-4ea1-a8bf-a7705d035859 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:53:57 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:57 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 1073741824 Jul 09 02:53:57 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-88416eec-9845-4259-a6fc-eefededefdaf tempest-SnapshotMetadataTestJSON-1812253920 None] Create snapshot completed successfully Jul 09 02:53:57 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" returned: 0 in 0.882s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:57 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca Jul 09 02:53:57 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:58 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" returned: 0 in 0.666s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-quobyte-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca" released by "delete_volume" :: held 1.605s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:58 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 1073741824" returned: 0 in 1.065s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Created reservations ['75b26f6f-def6-4f62-a93a-b72943a5f598', '32e62dca-5add-43f6-87b2-81aab7e2b794', 'dbb546e2-d0f4-440b-8c50-4b8a3ae7f60b', '5cd430a3-cdb2-4df5-8e29-9202bb22e599'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:58 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 Jul 09 02:53:58 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:58 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:53:58 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] GroupSnapshot 091fddeb-06c5-4f76-b813-54f638daaef2: creating. Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Group snapshot 091fddeb-06c5-4f76-b813-54f638daaef2: creating. {{(pid=87156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 02:53:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "cinder-f63df940-244d-43f8-a549-c381ad0a917c-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-f63df940-244d-43f8-a549-c381ad0a917c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "cinder-quobyte-f63df940-244d-43f8-a549-c381ad0a917c" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-f63df940-244d-43f8-a549-c381ad0a917c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Deleting offline snapshot f63df940-244d-43f8-a549-c381ad0a917c of volume 5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] snapshot_file for this snap is: volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c0c2b9-7226-4e02-9edf-376dd4971f40]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:59 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Creating offline snapshot 53759331-9914-471f-8504-b3fc0ccd90fc of volume edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e786e39e-9692-4039-a24f-16952ac22c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d5eb8b-e654-4995-8d9c-aa6ac990a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15f613-08d9-40d5-a857-c42824177e8a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:53:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Volume volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 (4064c8bc-1b98-4ea1-a8bf-a7705d035859): created successfully Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d5eb8b-e654-4995-8d9c-aa6ac990a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:53:59 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (a55f1658-f084-486a-a3b3-8ae441a9a91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.867s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:53:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Deleted volume successfully. Jul 09 02:53:59 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c Jul 09 02:53:59 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:53:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b9d76810-054b-4534-980a-29ba4a2f3aa5 tempest-VolumesListTestJSON-1250535146 None] Created volume successfully. Jul 09 02:53:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5b7e899f-ea9d-4117-9871-af296ca60591 tempest-VolumesDeleteCascade-1715340726 None] Lock "cinder-7bfdfdb0-3e5f-4eb7-98a5-6ab7b9bcc8ca-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:53:59 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 Jul 09 02:53:59 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:00 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c" returned: 0 in 0.901s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[081958c9-3c4c-4876-9e84-537ba38b67c1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:00 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5" returned: 0 in 0.883s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:00 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc 1G Jul 09 02:54:00 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:00 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c Jul 09 02:54:00 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:00 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (52f86402-f85e-41e2-a4c1-285168b9b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f23a9-dd97-48b5-89e1-25eb59619990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f23a9-dd97-48b5-89e1-25eb59619990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1727693091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:01Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d579bb-ad94-4bac-a78f-700d0ee7552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d579bb-ad94-4bac-a78f-700d0ee7552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6c025a-032b-4dd2-8075-8a5f2378b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6c025a-032b-4dd2-8075-8a5f2378b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365', 'volume_name': 'volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a915ea-be08-4694-8572-649abbfc3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a915ea-be08-4694-8572-649abbfc3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa56944-c255-4cfd-9817-165bf8410d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Volume 4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365', 'volume_size': 1} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:01 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c" returned: 0 in 1.034s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:01 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc 1G" returned: 0 in 1.013s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbf285f-24a3-4a60-bc49-a966955e18e5 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:01 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c Jul 09 02:54:01 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:01 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbf285f-24a3-4a60-bc49-a966955e18e5 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc Jul 09 02:54:01 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:01 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbf285f-24a3-4a60-bc49-a966955e18e5 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc" returned: 0 in 0.721s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:01 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:01 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c" returned: 0 in 0.787s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:01 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc Jul 09 02:54:01 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:01 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c Jul 09 02:54:01 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:02 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc" returned: 0 in 0.696s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=56,cinder:SELECT=71,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=51,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:02 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info Jul 09 02:54:02 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:02 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c.f63df940-244d-43f8-a549-c381ad0a917c" returned: 0 in 0.821s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-f63df940-244d-43f8-a549-c381ad0a917c" released by "_delete_snapshot" :: held 3.677s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" released by "delete_snapshot" :: held 3.710s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Created reservations ['68c5a9ee-0157-4693-8843-7136150bf498', '9ad56e12-c9e7-4944-8aae-7a82dc5fc3cd', '7c103308-a36d-4ec1-9075-37453b50936b', '4eb15c86-a4c1-4c22-b6c3-2c436d0200d4'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Delete snapshot completed successfully. Jul 09 02:54:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4ade23fd-b2fa-493f-a954-b0946932a783 tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-f63df940-244d-43f8-a549-c381ad0a917c-delete_snapshot" released by "delete_snapshot" :: held 3.883s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "cinder-5bdc4739-38bb-4252-8eaf-24edc1f7969c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:03 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info" returned: 0 in 0.757s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:03 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-5bdc4739-38bb-4252-8eaf-24edc1f7969c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:03 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info Jul 09 02:54:03 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f47bb-4fce-4603-8855-230112a3402a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:03 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c Jul 09 02:54:03 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Flow 'volume_create_manager' (1cc3c3ff-16b8-4b2f-b8ea-f0e916c44bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c24b4d-6a0d-4771-b5be-42938e7aa8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c24b4d-6a0d-4771-b5be-42938e7aa8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1467714816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309cc8dd-d4c7-40ae-b938-073be89c2e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488e251b49446da801da8785d807889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:04Z,use_quota=True,user_id='a68fb7cbfe8e4aed8cc69e7e850fd252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef067f-5d86-4a91-b715-b9cb40d6b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ef067f-5d86-4a91-b715-b9cb40d6b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0997f649-69f8-4cc8-a5ca-c421740ba438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0997f649-69f8-4cc8-a5ca-c421740ba438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309cc8dd-d4c7-40ae-b938-073be89c2e28', 'volume_name': 'volume-309cc8dd-d4c7-40ae-b938-073be89c2e28', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b247f-6671-4495-b9a7-474d81e76a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b247f-6671-4495-b9a7-474d81e76a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7be5d4-c8ef-41e0-9f6a-8208e9d2fc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:04 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Volume 309cc8dd-d4c7-40ae-b938-073be89c2e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309cc8dd-d4c7-40ae-b938-073be89c2e28', 'volume_size': 1} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:04 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.info" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Creating offline snapshot c81b2293-54c9-43cd-a86f-f18bd6a3c34a of volume 87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[763be0eb-4bbc-481f-9f16-517570710b0e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:04 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d Jul 09 02:54:04 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:04 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:04 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c Jul 09 02:54:04 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:04 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" returned: 0 in 0.773s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:04 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a 1G Jul 09 02:54:04 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:05 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5bdc4739-38bb-4252-8eaf-24edc1f7969c" returned: 0 in 0.658s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-quobyte-5bdc4739-38bb-4252-8eaf-24edc1f7969c" released by "delete_volume" :: held 1.587s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Created reservations ['fd15b75f-7854-43ac-b1ab-370885cf49ae', '56d597dc-7a3d-4543-a28f-663dc6a66d3c', '49df5bd0-de57-42f5-8ef5-975247dd385f', '6d7a9519-f6e6-478a-bf76-9ba1a8ba92f1'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:05 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:05 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:05 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a 1G" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:05 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a Jul 09 02:54:05 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:05 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Deleted volume successfully. Jul 09 02:54:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-252f5eee-91e4-413f-b4d0-61b7312841ba tempest-SnapshotMetadataTestJSON-1812253920 None] Lock "cinder-5bdc4739-38bb-4252-8eaf-24edc1f7969c-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:06 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a" returned: 0 in 0.788s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:06 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:06 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a Jul 09 02:54:06 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:07 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a" returned: 0 in 0.674s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:07 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info Jul 09 02:54:07 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:07 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info" returned: 0 in 0.659s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:07 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:07 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info Jul 09 02:54:07 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:08 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.info" returned: 0 in 0.657s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.545s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1467714816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309cc8dd-d4c7-40ae-b938-073be89c2e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488e251b49446da801da8785d807889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:04Z,use_quota=True,user_id='a68fb7cbfe8e4aed8cc69e7e850fd252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Creating volume 309cc8dd-d4c7-40ae-b938-073be89c2e28 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:08 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:08 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 1073741824 Jul 09 02:54:08 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7c64f1c4-aee1-4b59-abf6-934c53ec1e60 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 091fddeb-06c5-4f76-b813-54f638daaef2: created successfully Jul 09 02:54:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 091fddeb-06c5-4f76-b813-54f638daaef2: deleting Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 091fddeb-06c5-4f76-b813-54f638daaef2: deleting {{(pid=87156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-53759331-9914-471f-8504-b3fc0ccd90fc" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:09 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 1073741824" returned: 0 in 0.988s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-53759331-9914-471f-8504-b3fc0ccd90fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Deleting offline snapshot 53759331-9914-471f-8504-b3fc0ccd90fc of volume edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] snapshot_file for this snap is: volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4060b2b-55cb-43cb-89b4-fd0b9672f829]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:09 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 Jul 09 02:54:09 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:09 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc Jul 09 02:54:09 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:10 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28" returned: 0 in 0.685s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.236s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1727693091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:01Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Creating volume 4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:10 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7be5d4-c8ef-41e0-9f6a-8208e9d2fc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309cc8dd-d4c7-40ae-b938-073be89c2e28', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:10 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 1073741824 Jul 09 02:54:10 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59aaa38c-3b51-4830-b3dc-3952124c9fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:10 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Volume volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 (309cc8dd-d4c7-40ae-b938-073be89c2e28): created successfully Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59aaa38c-3b51-4830-b3dc-3952124c9fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Flow 'volume_create_manager' (1cc3c3ff-16b8-4b2f-b8ea-f0e916c44bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f00c77bb-22ec-4318-b8af-de123aa23bba tempest-VolumesTransfersV357Test-777966050 None] Created volume successfully. Jul 09 02:54:10 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc" returned: 0 in 0.920s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edbf285f-24a3-4a60-bc49-a966955e18e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b5e94-9a5e-4432-b6b5-c81ebc43bcee]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:10 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 Jul 09 02:54:10 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:11 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 1073741824" returned: 0 in 0.889s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:11 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 Jul 09 02:54:11 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:11 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5" returned: 0 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Flow 'volume_create_manager' (2dd68fc3-d5a7-4718-9b4e-e5a44aa9e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ceb2180-fad4-478d-9b1a-b43eef962c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:11 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc Jul 09 02:54:11 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ceb2180-fad4-478d-9b1a-b43eef962c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1197048915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5fd882-c207-4f6b-9236-8907b0d674bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e49b17d25244438843ddbd8a94aa1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:11Z,use_quota=True,user_id='6e69a2d69eb84ebd835020c5b178c433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fcb19c-edbc-415d-9e7f-c35906ad50d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fcb19c-edbc-415d-9e7f-c35906ad50d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b8f88-f82e-49e1-88a6-76cbfb29aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b8f88-f82e-49e1-88a6-76cbfb29aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5fd882-c207-4f6b-9236-8907b0d674bb', 'volume_name': 'volume-ef5fd882-c207-4f6b-9236-8907b0d674bb', 'volume_size': 2}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3316124-964d-4239-b25a-3f28368462c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3316124-964d-4239-b25a-3f28368462c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672e05d-e92e-4cb1-8f70-2f3636071df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Volume ef5fd882-c207-4f6b-9236-8907b0d674bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5fd882-c207-4f6b-9236-8907b0d674bb', 'volume_size': 2} Jul 09 02:54:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f02fda1f-c89a-4c29-b052-07c8663ba301 tempest-VolumesTransfersV357Test-468010375 None] Transfer volume completed successfully. Jul 09 02:54:12 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" returned: 0 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1197048915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5fd882-c207-4f6b-9236-8907b0d674bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e49b17d25244438843ddbd8a94aa1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:11Z,use_quota=True,user_id='6e69a2d69eb84ebd835020c5b178c433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Creating volume ef5fd882-c207-4f6b-9236-8907b0d674bb {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:12 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb 2147483648 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:12 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb 2147483648 Jul 09 02:54:12 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa56944-c255-4cfd-9817-165bf8410d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c15775f-566b-48a6-a4ad-152518140d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Volume volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 (4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365): created successfully Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c15775f-566b-48a6-a4ad-152518140d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (52f86402-f85e-41e2-a4c1-285168b9b185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f88df17b-d540-44ad-8714-1ac9edc7612b tempest-VolumesListTestJSON-1250535146 None] Created volume successfully. Jul 09 02:54:12 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc" returned: 0 in 0.777s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:12 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc Jul 09 02:54:12 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:13 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb 2147483648" returned: 0 in 0.968s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:13 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5.53759331-9914-471f-8504-b3fc0ccd90fc" returned: 0 in 0.733s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-53759331-9914-471f-8504-b3fc0ccd90fc" released by "_delete_snapshot" :: held 3.601s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" released by "delete_snapshot" :: held 3.631s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:13 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb Jul 09 02:54:13 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-c81b2293-54c9-43cd-a86f-f18bd6a3c34a" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "cinder-309cc8dd-d4c7-40ae-b938-073be89c2e28-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-c81b2293-54c9-43cd-a86f-f18bd6a3c34a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Deleting offline snapshot c81b2293-54c9-43cd-a86f-f18bd6a3c34a of volume 87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] snapshot_file for this snap is: volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-309cc8dd-d4c7-40ae-b938-073be89c2e28-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9a782-c5a9-4a05-a218-25c57a3c9366]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "cinder-quobyte-309cc8dd-d4c7-40ae-b938-073be89c2e28" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-quobyte-309cc8dd-d4c7-40ae-b938-073be89c2e28" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (5bbc05d8-ea87-433c-9cbb-124e638b45ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9981458a-4e3e-4ac0-a912-5c0e73ead029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d41e27-ba8b-45b5-bd0d-a59755617e95]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:13 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a Jul 09 02:54:13 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9981458a-4e3e-4ac0-a912-5c0e73ead029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477044998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12703cdd-3cc0-49ad-a7b8-ae38b5db83bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:13Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e4f37f-777b-45e7-b48f-b8fa87c0760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e4f37f-777b-45e7-b48f-b8fa87c0760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997ab00f-4b88-4257-a5a3-19b9024bc7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997ab00f-4b88-4257-a5a3-19b9024bc7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12703cdd-3cc0-49ad-a7b8-ae38b5db83bd', 'volume_name': 'volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a35d95-3262-40e4-a02a-8771c23d5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a35d95-3262-40e4-a02a-8771c23d5d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a8c69a-7726-403b-b71d-68903fd91133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:13 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Volume 12703cdd-3cc0-49ad-a7b8-ae38b5db83bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd', 'volume_size': 1} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:13 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 Jul 09 02:54:13 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:13 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477044998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12703cdd-3cc0-49ad-a7b8-ae38b5db83bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6b6583368a64d62948ea6b427fbfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:13Z,use_quota=True,user_id='7a552093092c45c58058b493c600d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Creating volume 12703cdd-3cc0-49ad-a7b8-ae38b5db83bd {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:13 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:14 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd 1073741824 Jul 09 02:54:14 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672e05d-e92e-4cb1-8f70-2f3636071df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5fd882-c207-4f6b-9236-8907b0d674bb', 'volume_size': 2}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3da9fb2-6691-4f54-afcd-e939d310863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:14 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Volume volume-ef5fd882-c207-4f6b-9236-8907b0d674bb (ef5fd882-c207-4f6b-9236-8907b0d674bb): created successfully Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3da9fb2-6691-4f54-afcd-e939d310863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Flow 'volume_create_manager' (2dd68fc3-d5a7-4718-9b4e-e5a44aa9e963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-54298c9d-25f9-4c3e-9865-894358819e9f tempest-VolumesCloneNegativeTest-510035837 None] Created volume successfully. Jul 09 02:54:14 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a" returned: 0 in 0.933s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c568691-d60d-4aab-9aca-598ae9c69dd7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:14 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d Jul 09 02:54:14 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:14 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28" returned: 0 in 0.947s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:14 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28 Jul 09 02:54:14 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:14 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Acquiring lock "cinder-ef5fd882-c207-4f6b-9236-8907b0d674bb-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd 1073741824" returned: 0 in 0.973s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "cinder-ef5fd882-c207-4f6b-9236-8907b0d674bb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Acquiring lock "cinder-quobyte-ef5fd882-c207-4f6b-9236-8907b0d674bb" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:15 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd Jul 09 02:54:15 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "cinder-quobyte-ef5fd882-c207-4f6b-9236-8907b0d674bb" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18014b2-365c-4a73-941f-f8f908db5f26]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:15 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-309cc8dd-d4c7-40ae-b938-073be89c2e28" returned: 0 in 0.749s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:15 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" returned: 0 in 0.889s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-quobyte-309cc8dd-d4c7-40ae-b938-073be89c2e28" released by "delete_volume" :: held 1.780s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:15 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a Jul 09 02:54:15 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:15 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb Jul 09 02:54:15 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Created reservations ['e605070e-b4ea-454e-8e49-2e6382ef595b', '14cdaf44-2f8a-4212-8c8e-c7fb12020bdd', '87701430-ae31-488a-b3c9-c32fc6434fea', '85779e41-71ae-4ac3-94b5-e8b3b7b15255'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:15 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:15 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:15 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" returned: 0 in 0.927s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a8c69a-7726-403b-b71d-68903fd91133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79a5e30-5e93-4d33-bbe5-fb01cceabfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Volume volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd (12703cdd-3cc0-49ad-a7b8-ae38b5db83bd): created successfully Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79a5e30-5e93-4d33-bbe5-fb01cceabfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Flow 'volume_create_manager' (5bbc05d8-ea87-433c-9cbb-124e638b45ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d8969c74-df4d-4bfd-8921-4e004064d526 tempest-VolumesListTestJSON-1250535146 None] Created volume successfully. Jul 09 02:54:16 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb" returned: 0 in 1.072s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:16 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb Jul 09 02:54:16 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Flow 'volume_create_manager' (e6d33bbe-70d9-4904-9b5a-323a2f806e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:16 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8f4fef-d9f7-4d52-ac96-0c31cf2e166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.983s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8f4fef-d9f7-4d52-ac96-0c31cf2e166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1856485224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffcf63b8-7c0d-402f-93d0-e528da778b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488e251b49446da801da8785d807889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:16Z,use_quota=True,user_id='a68fb7cbfe8e4aed8cc69e7e850fd252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c794bf0-4353-40d1-bb21-58c4676f2668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c794bf0-4353-40d1-bb21-58c4676f2668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f11654-6b2d-4110-a219-c4a80871e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f11654-6b2d-4110-a219-c4a80871e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffcf63b8-7c0d-402f-93d0-e528da778b0b', 'volume_name': 'volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabc727d-5e23-4c20-bf8f-b14b90e67483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabc727d-5e23-4c20-bf8f-b14b90e67483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75231d54-89e0-45bf-ba3a-b8e71f0003df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Volume ffcf63b8-7c0d-402f-93d0-e528da778b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b', 'volume_size': 1} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1856485224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffcf63b8-7c0d-402f-93d0-e528da778b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488e251b49446da801da8785d807889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:16Z,use_quota=True,user_id='a68fb7cbfe8e4aed8cc69e7e850fd252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Creating volume ffcf63b8-7c0d-402f-93d0-e528da778b0b {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:16 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:16 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Deleted volume successfully. Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a" returned: 0 in 1.252s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:16 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b 1073741824 Jul 09 02:54:16 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:16 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6b5e0c33-1991-45c1-883a-4071a40d2977 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-309cc8dd-d4c7-40ae-b938-073be89c2e28-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:16 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:16 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef5fd882-c207-4f6b-9236-8907b0d674bb" returned: 0 in 0.787s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "cinder-quobyte-ef5fd882-c207-4f6b-9236-8907b0d674bb" released by "delete_volume" :: held 1.921s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Created reservations ['f403fe71-7751-4b53-ab1a-f6abd80cd3ff', '83f0cdd1-85f8-4c09-b800-609864ca01c9', 'cc1ac532-c8db-44e7-b828-84090bb1cd91', '9e5b5bf3-bebf-40b2-ac0c-5e90432f304a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:17 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:17 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:17 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d.c81b2293-54c9-43cd-a86f-f18bd6a3c34a" returned: 0 in 0.889s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-c81b2293-54c9-43cd-a86f-f18bd6a3c34a" released by "_delete_snapshot" :: held 4.094s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" released by "delete_snapshot" :: held 4.136s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:17 devstack cinder-volume[87156]: WARNING cinder.quota [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-328156918 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-328156918, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:17 devstack cinder-volume[87156]: WARNING cinder.quota [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-328156918 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-328156918, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['fac27a0b-1efa-40ff-a3b8-9337291093b6', 'ce35b59c-5362-4067-b185-82ee997762a1', '3411253c-0fad-4e1a-82b3-065e04b27a84', '9328755f-207f-46c2-844a-7d851ac29757'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:17 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b 1073741824" returned: 0 in 1.162s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:17 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['0c605d86-dabf-4f46-8b54-b3730ad10d92', '85cc9f20-6d09-4726-bc06-42f93fb229d3', '5d2b9af5-e63f-4895-bf75-4f469a591d4a', '462dd5dd-a880-45ea-aa4b-2f5feabf3a97'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:17 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b Jul 09 02:54:17 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f4aa47c3-efdb-4219-998a-e44b8a63eea3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 091fddeb-06c5-4f76-b813-54f638daaef2: deleted successfully Jul 09 02:54:18 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.935s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Deleted volume successfully. Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cfb8ae55-a6a2-4ee3-b7ec-e7c3ba63e2df tempest-VolumesCloneNegativeTest-510035837 None] Lock "cinder-ef5fd882-c207-4f6b-9236-8907b0d674bb-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:18 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b" returned: 0 in 0.833s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75231d54-89e0-45bf-ba3a-b8e71f0003df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee44f6c-c155-4070-8975-71541037614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Volume volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b (ffcf63b8-7c0d-402f-93d0-e528da778b0b): created successfully Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee44f6c-c155-4070-8975-71541037614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Flow 'volume_create_manager' (e6d33bbe-70d9-4904-9b5a-323a2f806e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-608f3190-2394-4a5d-a4b2-4e3449d5f628 tempest-VolumesTransfersV357Test-777966050 None] Created volume successfully. Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[30013657-ebca-412e-a02d-6c125ebfee59]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:19 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d Jul 09 02:54:19 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-quobyte-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ffe64-76bd-4a0a-a7d6-bb2983fe16f2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:19 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd Jul 09 02:54:19 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "cinder-ffcf63b8-7c0d-402f-93d0-e528da778b0b-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-ffcf63b8-7c0d-402f-93d0-e528da778b0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:19 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" returned: 0 in 0.953s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:19 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d Jul 09 02:54:19 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "cinder-quobyte-ffcf63b8-7c0d-402f-93d0-e528da778b0b" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-quobyte-ffcf63b8-7c0d-402f-93d0-e528da778b0b" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d1f6a-1c69-4d55-9505-b616abc3dc8c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:20 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b Jul 09 02:54:20 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:20 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" returned: 0 in 1.100s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:20 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd Jul 09 02:54:20 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:20 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" returned: 0 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-87977ba0-a3a4-4b26-9e3e-7d0214657b2d" released by "delete_volume" :: held 1.786s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34d4d6-df89-42a9-9115-4e84d4c3753e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:20 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 Jul 09 02:54:20 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:20 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b" returned: 0 in 0.950s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:20 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b Jul 09 02:54:20 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:21 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" returned: 0 in 0.846s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd" released by "delete_volume" :: held 1.999s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Created reservations ['5eff9080-fbba-44b3-9b1f-8a379ef3efd8', 'c540a874-b8f4-479f-b935-9333135ad3b5', '5653e470-86f7-458e-87d7-b266d59493f9', 'dc36d239-a861-423f-af7c-15a22a4ee78b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:21 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:21 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:21 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5" returned: 0 in 1.013s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:21 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5 Jul 09 02:54:21 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:21 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ffcf63b8-7c0d-402f-93d0-e528da778b0b" returned: 0 in 0.984s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-quobyte-ffcf63b8-7c0d-402f-93d0-e528da778b0b" released by "delete_volume" :: held 2.002s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Created reservations ['0664f236-48e7-4c34-b617-6d00803a9867', '7cd2735d-c0c3-47cc-9825-fd8a3192a283', '37b4ecf6-be4f-497b-9f05-704bd7738d3f', 'c6f28c6c-5bfc-4762-b011-4b5d65f95128'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:22 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:22 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:22 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.874s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Deleted volume successfully. Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-292e9cb6-4ee9-449a-9bb7-b97cf03909e4 tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-12703cdd-3cc0-49ad-a7b8-ae38b5db83bd-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:22 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-edbf285f-24a3-4a60-bc49-a966955e18e5" returned: 0 in 1.130s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-edbf285f-24a3-4a60-bc49-a966955e18e5" released by "delete_volume" :: held 2.234s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-quobyte-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" acquired by "delete_volume" :: waited 0.053s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[74445a0c-904b-43b2-a97d-d7d370f7a29a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['c17d2a3b-7e7c-4a69-85dc-59c12879a54b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:23 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-328156918 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-328156918, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['5a085747-47ba-4168-8f00-a9aa394171b8', '5404bb80-e9c5-46d4-b6f1-8b3898612bcb', '7e6ed158-ef06-46f6-ab23-75158d1a138e', '0c36bbea-4c67-47c5-b5bc-5008814712c5'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:23 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:23 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 Jul 09 02:54:23 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.086s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Deleted volume successfully. Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-035b2405-1a5b-47a5-94f7-3f6163715ce7 tempest-VolumesTransfersV357Test-1981346758 None] Lock "cinder-ffcf63b8-7c0d-402f-93d0-e528da778b0b-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['f6b08d18-ebf6-43d9-85aa-9466886d24a9', 'f7d3533d-83cb-4541-8b8f-e910cb0a5b0c', 'af815670-34a9-46e7-9332-970c91868d8a', '93a79d60-b745-48c1-aa15-9828cc63d2bb'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:23 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:23 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:24 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" returned: 0 in 1.121s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:24 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365 Jul 09 02:54:24 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:24 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.953s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:24 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:24 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d22d9710-3be9-462a-8280-ab5be042eb66 tempest-GroupSnapshotsTest-225472218 None] Delete group completed successfully. Jul 09 02:54:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2d205a07-8e85-464e-ae60-611de4c6f636 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1203047233: creating Jul 09 02:54:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2d205a07-8e85-464e-ae60-611de4c6f636 tempest-GroupSnapshotsTest-225472218 None] Group tempest-GroupSnapshotsTest-Group-1203047233: created successfully Jul 09 02:54:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2d205a07-8e85-464e-ae60-611de4c6f636 tempest-GroupSnapshotsTest-225472218 None] Create group completed successfully. Jul 09 02:54:25 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" returned: 0 in 0.986s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365" released by "delete_volume" :: held 2.167s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Created reservations ['ca5c13a4-5dd0-49d0-b100-df51042cfbc0', '3d13df60-ec32-4178-887e-b23c623b29e1', 'e8f51fd2-1427-48a2-b307-fa9d9b99fb0a', '1cddc407-4b1c-49fa-880a-053702b08a95'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:25 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:25 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:26 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Deleted volume successfully. Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ddc3f18-53c0-4f64-9eb8-5f204da1f6ec tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-4e1f07f4-3aa3-483c-a22b-ceeb2dc7c365-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-4064c8bc-1b98-4ea1-a8bf-a7705d035859-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-4064c8bc-1b98-4ea1-a8bf-a7705d035859-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "cinder-quobyte-4064c8bc-1b98-4ea1-a8bf-a7705d035859" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-4064c8bc-1b98-4ea1-a8bf-a7705d035859" acquired by "delete_volume" :: waited 0.039s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3cd587-1c70-4a38-ae2c-51ef66dbf5a1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:26 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 Jul 09 02:54:26 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (e33064f4-5bf2-45a8-bb9a-7606068149f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6466ee9-669f-4427-82c0-053001918d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6466ee9-669f-4427-82c0-053001918d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570160706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a117f1b-f294-4cd2-ba92-13650778904c,host='devstack@QuobyteHD#QuobyteHD',id=d2b177cd-1657-4442-8a9e-15bfb57dfdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:27Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdfaf44-ae7b-4377-9097-1310678e41b5),volume_type_id=5cdfaf44-ae7b-4377-9097-1310678e41b5)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acf264a-3dc9-4c3d-b446-e9a0489d874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acf264a-3dc9-4c3d-b446-e9a0489d874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a8409a-4154-4797-906f-52ef9a60d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a8409a-4154-4797-906f-52ef9a60d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b177cd-1657-4442-8a9e-15bfb57dfdbb', 'volume_name': 'volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e93876b-a937-4d26-9f0a-b202645badae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e93876b-a937-4d26-9f0a-b202645badae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3461920f-7700-4e48-9fc0-e3714116ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Volume d2b177cd-1657-4442-8a9e-15bfb57dfdbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb', 'volume_size': 1} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a117f1b-f294-4cd2-ba92-13650778904c,created_at=2026-07-09T00:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570160706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a117f1b-f294-4cd2-ba92-13650778904c,host='devstack@QuobyteHD#QuobyteHD',id=d2b177cd-1657-4442-8a9e-15bfb57dfdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59ba8cfff224ee8bbcf75187e3fb85b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:27Z,use_quota=True,user_id='edcd0edc96cf464a93d2dc808983bff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdfaf44-ae7b-4377-9097-1310678e41b5),volume_type_id=5cdfaf44-ae7b-4377-9097-1310678e41b5)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Creating volume d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:27 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:27 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb 1073741824 Jul 09 02:54:27 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:27 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859" returned: 0 in 1.301s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:27 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:27 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:27 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859 Jul 09 02:54:28 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:28 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb 1073741824" returned: 0 in 1.339s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:28 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb Jul 09 02:54:28 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:28 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.047s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:54:28 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4064c8bc-1b98-4ea1-a8bf-a7705d035859" returned: 0 in 1.035s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-quobyte-4064c8bc-1b98-4ea1-a8bf-a7705d035859" released by "delete_volume" :: held 2.411s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Created reservations ['c2f8d6e4-5ddc-4d34-991d-bed523827fb4', '57986292-a586-46ba-8106-feb88986d783', '19d525a5-4f46-4945-b115-9462452f8442', '8ef93307-39f6-4ac0-8a86-c0151bdb1868'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:29 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:29 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:29 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" returned: 0 in 0.813s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3461920f-7700-4e48-9fc0-e3714116ceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7e0ebb-59b4-40a2-99b1-7548ab2478d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Volume volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb (d2b177cd-1657-4442-8a9e-15bfb57dfdbb): created successfully Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7e0ebb-59b4-40a2-99b1-7548ab2478d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Flow 'volume_create_manager' (e33064f4-5bf2-45a8-bb9a-7606068149f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6d81306d-ba24-4312-bd9c-daf47ff164bb tempest-GroupSnapshotsTest-225472218 None] Created volume successfully. Jul 09 02:54:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] GroupSnapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: creating. Jul 09 02:54:30 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.918s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Deleted volume successfully. Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Group snapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: creating. {{(pid=87156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cdee0dee-ef19-4bcc-9b97-847e50571fdc tempest-VolumesListTestJSON-1250535146 None] Lock "cinder-4064c8bc-1b98-4ea1-a8bf-a7705d035859-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Creating offline snapshot 294869fd-745b-4130-bae8-5f6db3347d9b of volume d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28c6ea-1ab5-48a0-832a-fbf03e1b97ee]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:30 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb Jul 09 02:54:30 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Flow 'volume_create_manager' (f7d2245e-d0d5-45db-bc9d-6eac970a4060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f031c15-d48c-482c-8893-3cbd1f5f3e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f031c15-d48c-482c-8893-3cbd1f5f3e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-542643250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587648a-0cfb-43e5-9607-fef0a9190b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b82ad409e35450db71afbefeae3f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:31Z,use_quota=True,user_id='dfafdf7cc8744c8499b0ecb33723384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644afe49-7aef-406d-9e10-9d3425493177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644afe49-7aef-406d-9e10-9d3425493177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918e810-0ce1-4759-8073-8ffbe058e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:30 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 02:54:31 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" returned: 0 in 1.130s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:31 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b 1G Jul 09 02:54:31 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f918e810-0ce1-4759-8073-8ffbe058e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6587648a-0cfb-43e5-9607-fef0a9190b56', 'volume_name': 'volume-6587648a-0cfb-43e5-9607-fef0a9190b56', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85303a7-0f93-40f4-b26f-2dc4dc6739d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85303a7-0f93-40f4-b26f-2dc4dc6739d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6e9d04-48d0-4817-8804-988f3b408bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Volume 6587648a-0cfb-43e5-9607-fef0a9190b56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6587648a-0cfb-43e5-9607-fef0a9190b56', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Trying to clone 6587648a-0cfb-43e5-9607-fef0a9190b56 from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 02:54:31 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 02:54:31 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Image download 20.69 MB at 20.69 MB/s Jul 09 02:54:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4868dfd-e4eb-451a-a318-650600b0f102]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:32 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD Jul 09 02:54:32 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:32 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b 1G" returned: 0 in 1.240s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:32 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b Jul 09 02:54:32 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:33 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD" returned: 0 in 1.031s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 is fetched for user dfafdf7cc8744c8499b0ecb33723384b. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18860b-ef2c-4ae8-9b90-762b36acdb74]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:33 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD Jul 09 02:54:33 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:33 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b" returned: 0 in 1.014s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:33 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:33 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b Jul 09 02:54:33 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:34 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD" returned: 0 in 1.062s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:34 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b" returned: 0 in 1.107s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:34 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info Jul 09 02:54:34 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Flow 'volume_create_manager' (1f1e0809-5376-4b1a-8861-22a241278c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa0dfb-0bc4-4749-8276-9b61d3418eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaa0dfb-0bc4-4749-8276-9b61d3418eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-572956782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35732fc3-9d89-4316-99c8-ef17900fe58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2c219fa8f44fa7a02b1a45306545e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:35Z,use_quota=True,user_id='001f7e55120644229e06cc54decbcc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ca2957-1d9d-4c60-8ef8-07d0399ee9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ca2957-1d9d-4c60-8ef8-07d0399ee9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0a27bc-1ad7-4fe2-a7cb-76c66e529f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0a27bc-1ad7-4fe2-a7cb-76c66e529f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35732fc3-9d89-4316-99c8-ef17900fe58c', 'volume_name': 'volume-35732fc3-9d89-4316-99c8-ef17900fe58c', 'volume_size': 2}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb6a355-8b88-4181-b7c4-bcefcae7afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb6a355-8b88-4181-b7c4-bcefcae7afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302559ee-518f-486f-a89d-7b52be687a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:35 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Volume 35732fc3-9d89-4316-99c8-ef17900fe58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35732fc3-9d89-4316-99c8-ef17900fe58c', 'volume_size': 2} Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:35 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:35 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:35 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info Jul 09 02:54:35 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:36 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.info" returned: 0 in 0.705s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.057s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-542643250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587648a-0cfb-43e5-9607-fef0a9190b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b82ad409e35450db71afbefeae3f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:31Z,use_quota=True,user_id='dfafdf7cc8744c8499b0ecb33723384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Creating volume 6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:36 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:36 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1073741824 Jul 09 02:54:36 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-72b702de-4463-49e4-9cb4-fecf078ba053 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: created successfully Jul 09 02:54:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: deleting Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: deleting {{(pid=87156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-294869fd-745b-4130-bae8-5f6db3347d9b" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-294869fd-745b-4130-bae8-5f6db3347d9b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Deleting offline snapshot 294869fd-745b-4130-bae8-5f6db3347d9b of volume d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] snapshot_file for this snap is: volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd246a56-22c5-4eba-9edf-c1ec7d2247ff]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:37 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b Jul 09 02:54:37 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:37 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1073741824" returned: 0 in 0.964s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:37 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:37 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (9327f74a-4653-404a-bfb4-8f1fd2f36f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c93417-7065-487e-b437-685313ff4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c93417-7065-487e-b437-685313ff4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1008413764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf789b6a-2083-437b-abf2-6f7244762101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:37Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2404c67-6e8a-4aa8-959b-25a35f6f2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2404c67-6e8a-4aa8-959b-25a35f6f2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8bc1f7-7fb2-4c17-b543-11d612aeb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8bc1f7-7fb2-4c17-b543-11d612aeb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf789b6a-2083-437b-abf2-6f7244762101', 'volume_name': 'volume-cf789b6a-2083-437b-abf2-6f7244762101', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97763b1-dd27-4d66-874a-eba414341b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97763b1-dd27-4d66-874a-eba414341b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3942d54a-96cc-4c60-878f-b15407cbbc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Volume cf789b6a-2083-437b-abf2-6f7244762101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf789b6a-2083-437b-abf2-6f7244762101', 'volume_size': 1} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:37 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[789327ca-f784-49e9-afc3-154410397a08]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:37 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb Jul 09 02:54:37 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:37 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 0.722s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.812s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-572956782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35732fc3-9d89-4316-99c8-ef17900fe58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2c219fa8f44fa7a02b1a45306545e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:35Z,use_quota=True,user_id='001f7e55120644229e06cc54decbcc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Creating volume 35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:37 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c 2147483648 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:38 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c 2147483648 Jul 09 02:54:38 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Attempting download of db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 6587648a-0cfb-43e5-9607-fef0a9190b56. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176f069-cabb-4dcb-8d2c-89819db8190f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:38 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q Jul 09 02:54:38 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:38 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" returned: 0 in 0.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:38 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b Jul 09 02:54:38 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:38 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q" returned: 0 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:38 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c 2147483648" returned: 0 in 0.957s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:39 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c Jul 09 02:54:39 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:39 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q Jul 09 02:54:39 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:39 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b" returned: 0 in 0.780s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:39 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b Jul 09 02:54:39 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:39 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q" returned: 1 in 0.780s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_dg64wi7q' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b3a5df-d033-4b8e-a0c7-e6400bd25bb6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:39 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c" returned: 0 in 0.744s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1008413764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf789b6a-2083-437b-abf2-6f7244762101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:37Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Creating volume cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:39 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:39 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 1073741824 Jul 09 02:54:39 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302559ee-518f-486f-a89d-7b52be687a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35732fc3-9d89-4316-99c8-ef17900fe58c', 'volume_size': 2}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c106417-feff-4f0e-9dd2-75fcd4e14115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:39 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD Jul 09 02:54:39 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Volume volume-35732fc3-9d89-4316-99c8-ef17900fe58c (35732fc3-9d89-4316-99c8-ef17900fe58c): created successfully Jul 09 02:54:39 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c106417-feff-4f0e-9dd2-75fcd4e14115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Flow 'volume_create_manager' (1f1e0809-5376-4b1a-8861-22a241278c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-98c6422b-8aa7-482f-a2f0-4351c92685dc tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Created volume successfully. Jul 09 02:54:40 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb.294869fd-745b-4130-bae8-5f6db3347d9b" returned: 0 in 0.734s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-294869fd-745b-4130-bae8-5f6db3347d9b" released by "_delete_snapshot" :: held 3.252s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" released by "delete_snapshot" :: held 3.283s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:40 devstack cinder-volume[87156]: WARNING cinder.quota [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1268591329 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1268591329, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:40 devstack cinder-volume[87156]: WARNING cinder.quota [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1268591329 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1268591329, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['7aa8e0de-a5a6-469b-938d-b535eee4be86', '90bf9714-9b68-4ddb-87ec-4c4227bcef46', '20b20ca0-ce58-4f1d-bb3c-5da49bdb8705', '5f4f9aea-94ac-4c13-b286-484c3185cabf'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ec99519f-bab0-4ef6-b447-a066fad6d2b3 tempest-GroupSnapshotsTest-225472218 None] group_snapshot 7979d667-8ab1-4825-bada-879e1f3e85e9: deleted successfully Jul 09 02:54:40 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] db9c7883-aaf0-4c13-905a-75c00f73e5a1 was qcow2, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:40 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:40 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:40 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 1073741824" returned: 0 in 0.952s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:40 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 Jul 09 02:54:40 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:41 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.778s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3942d54a-96cc-4c60-878f-b15407cbbc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf789b6a-2083-437b-abf2-6f7244762101', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aaf882-6ace-416e-b5f5-cef47c543f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Creating offline snapshot 14828d5d-dffe-4d82-be2c-459ac981da2e of volume 35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:54:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Volume volume-cf789b6a-2083-437b-abf2-6f7244762101 (cf789b6a-2083-437b-abf2-6f7244762101): created successfully Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aaf882-6ace-416e-b5f5-cef47c543f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (9327f74a-4653-404a-bfb4-8f1fd2f36f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a24f029-02db-49d7-817b-6f29f68a2af0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-af0c2ecd-6984-4985-8cee-83ddf650869f tempest-VolumesSnapshotTestJSON-516389980 None] Created volume successfully. Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c13b25d-0934-4605-b82f-95c9faa5a2f4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:41 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c Jul 09 02:54:41 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:41 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb Jul 09 02:54:41 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:42 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c" returned: 0 in 0.940s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e 2G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:42 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e 2G Jul 09 02:54:42 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:42 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" returned: 0 in 0.988s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:42 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb Jul 09 02:54:42 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:42 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 2.315s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fmh2ldgtdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:54:42 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Converted 112.00 MB image at 48.34 MB/s Jul 09 02:54:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:42 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1G Jul 09 02:54:42 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:43 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e 2G" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35732fc3-9d89-4316-99c8-ef17900fe58c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:43 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:43 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35732fc3-9d89-4316-99c8-ef17900fe58c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e Jul 09 02:54:43 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Lock "cinder-quobyte-d2b177cd-1657-4442-8a9e-15bfb57dfdbb" released by "delete_volume" :: held 1.792s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['f379a1b0-bfde-4286-897e-3589e69e2110'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:43 devstack cinder-volume[87156]: WARNING cinder.quota [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1268591329 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1268591329, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Created reservations ['a97dd958-9f5c-40da-bf1d-353357a7e1f8', '6b28f341-befb-4363-89b5-5e0a49d60fa6', '6df9fe15-2865-4bf3-a1f5-0086cb99f47a', '730cd987-8a3d-4aad-ae7d-2008ff688ecb'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:43 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:43 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:43 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 1G" returned: 0 in 0.932s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4c8f6d-39dc-4796-b747-1a9e090d9611]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:44 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:44 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:44 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35732fc3-9d89-4316-99c8-ef17900fe58c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e" returned: 0 in 0.851s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:44 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e is being set with open permissions: ugo+rw Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:44 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e Jul 09 02:54:44 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:44 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.815s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b66682e3-242e-46ce-b88d-b85c6a02f2d2 tempest-GroupSnapshotsTest-225472218 None] Delete group completed successfully. Jul 09 02:54:44 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 0.841s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:44 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:44 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:45 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e" returned: 0 in 0.746s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:45 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info Jul 09 02:54:45 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:45 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 1 in 0.942s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Downloaded image db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 6587648a-0cfb-43e5-9607-fef0a9190b56 successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 for user dfafdf7cc8744c8499b0ecb33723384b is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Marking volume 6587648a-0cfb-43e5-9607-fef0a9190b56 as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Copying metadata from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 to 6587648a-0cfb-43e5-9607-fef0a9190b56. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Creating volume glance metadata for volume 6587648a-0cfb-43e5-9607-fef0a9190b56 backed by image db9c7883-aaf0-4c13-905a-75c00f73e5a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6e9d04-48d0-4817-8804-988f3b408bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6587648a-0cfb-43e5-9607-fef0a9190b56', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e9fac5-ce7d-4c2c-8e81-8d2b361da3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Volume volume-6587648a-0cfb-43e5-9607-fef0a9190b56 (6587648a-0cfb-43e5-9607-fef0a9190b56): created successfully Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e9fac5-ce7d-4c2c-8e81-8d2b361da3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Flow 'volume_create_manager' (f7d2245e-d0d5-45db-bc9d-6eac970a4060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7c5e7631-b853-489c-b159-da1e2224ce6c tempest-VolumesExtendTest-976434951 None] Created volume successfully. Jul 09 02:54:45 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info" returned: 0 in 0.869s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:45 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info is being set with open permissions: ugo+rw Jul 09 02:54:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:45 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info Jul 09 02:54:45 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:46 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.info" returned: 0 in 0.787s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.348s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.608s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Creating offline snapshot bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 of volume cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:54:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-be66eb14-62c3-4ff1-b98b-8f398027a2e4 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Create snapshot completed successfully Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f0495-b78c-4eba-b442-dc4e21421f8f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:46 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 Jul 09 02:54:46 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "cinder-14828d5d-dffe-4d82-be2c-459ac981da2e-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-14828d5d-dffe-4d82-be2c-459ac981da2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "cinder-quobyte-14828d5d-dffe-4d82-be2c-459ac981da2e" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-14828d5d-dffe-4d82-be2c-459ac981da2e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Deleting offline snapshot 14828d5d-dffe-4d82-be2c-459ac981da2e of volume 35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] snapshot_file for this snap is: volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0459538c-88a2-4237-a7d5-985d67e4eeb2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:47 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e Jul 09 02:54:47 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:47 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101" returned: 0 in 0.917s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:47 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 1G Jul 09 02:54:47 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:48 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e" returned: 0 in 0.928s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35732fc3-9d89-4316-99c8-ef17900fe58c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[910b05c4-04c3-4060-b763-8f1c56ad273d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:48 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c Jul 09 02:54:48 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:48 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 1G" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf789b6a-2083-437b-abf2-6f7244762101 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:48 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf789b6a-2083-437b-abf2-6f7244762101 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 Jul 09 02:54:48 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:49 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:49 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e Jul 09 02:54:49 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:49 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf789b6a-2083-437b-abf2-6f7244762101 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" returned: 0 in 0.869s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:49 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 is being set with open permissions: ugo+rw Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:49 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 Jul 09 02:54:49 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-636270df-2231-47b4-a383-9b5c2852b073 tempest-GroupSnapshotsV319Test-1114627058 None] Group tempest-GroupSnapshotsV319Test-Group-617501440: creating Jul 09 02:54:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-636270df-2231-47b4-a383-9b5c2852b073 tempest-GroupSnapshotsV319Test-1114627058 None] Group tempest-GroupSnapshotsV319Test-Group-617501440: created successfully Jul 09 02:54:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-636270df-2231-47b4-a383-9b5c2852b073 tempest-GroupSnapshotsV319Test-1114627058 None] Create group completed successfully. Jul 09 02:54:49 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e" returned: 0 in 0.936s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:49 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e Jul 09 02:54:49 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:50 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" returned: 0 in 0.678s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:50 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info Jul 09 02:54:50 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:50 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c.14828d5d-dffe-4d82-be2c-459ac981da2e" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-14828d5d-dffe-4d82-be2c-459ac981da2e" released by "_delete_snapshot" :: held 3.575s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" released by "delete_snapshot" :: held 3.602s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Created reservations ['78a412c8-707f-4748-80ed-0a54d48025c3', '50dce03d-6720-4574-9d5a-202125af8a3c', '2119c3ae-cd90-4966-80cc-9106f74194bb', '9e96d5f5-82b0-47a4-9bc9-da15b8a889e7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Delete snapshot completed successfully. Jul 09 02:54:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-829fffe0-6072-453b-8221-a55f813abd9d tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-14828d5d-dffe-4d82-be2c-459ac981da2e-delete_snapshot" released by "delete_snapshot" :: held 3.798s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:51 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:51 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info is being set with open permissions: ugo+rw Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:51 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info Jul 09 02:54:51 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "cinder-35732fc3-9d89-4316-99c8-ef17900fe58c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Flow 'volume_create_manager' (a87f0733-4851-408a-bc58-c87e3940e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209a3b68-3fc9-436a-a5ac-479846d456cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-35732fc3-9d89-4316-99c8-ef17900fe58c-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209a3b68-3fc9-436a-a5ac-479846d456cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768478359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fecf6f5-e426-4c81-9ba2-7c89c325a9c7,host='devstack@QuobyteHD#QuobyteHD',id=a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c5c9817d01424a889bb69d95ac8033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:51Z,use_quota=True,user_id='1a436c752644469290a478e1b0687391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2899eea2-459d-4f12-941e-615059705ceb),volume_type_id=2899eea2-459d-4f12-941e-615059705ceb)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba16239-12ea-482a-9a01-e71caef7cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba16239-12ea-482a-9a01-e71caef7cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbf4da9-e45c-4ede-b488-97751f7afb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbf4da9-e45c-4ede-b488-97751f7afb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79', 'volume_name': 'volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d47619-1944-4962-949d-06facb158d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d47619-1944-4962-949d-06facb158d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c66ac8-b634-405b-b439-af1c51acaa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Volume a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79', 'volume_size': 1} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[75071882-8d39-45b5-8a98-5656d0adffbe]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:51 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.info" returned: 0 in 0.828s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:51 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c Jul 09 02:54:51 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.140s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.762s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9192cd-0e1c-4028-848b-94abb182b06f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-97da3bf0-ef4c-4e8d-a80d-656d96bf9472 tempest-VolumesSnapshotTestJSON-516389980 None] Create snapshot completed successfully Jul 09 02:54:52 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:52 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:52 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c" returned: 0 in 0.982s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:52 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c Jul 09 02:54:52 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:52 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 0.889s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:52 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:52 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Deleting offline snapshot bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 of volume cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] snapshot_file for this snap is: volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55caaec-9a8a-45c7-bff3-a7ca4424ee5b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:53 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 Jul 09 02:54:53 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:53 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35732fc3-9d89-4316-99c8-ef17900fe58c" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-quobyte-35732fc3-9d89-4316-99c8-ef17900fe58c" released by "delete_volume" :: held 1.728s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Created reservations ['59e2bf2e-c7bb-4951-a371-568f96452077', 'd1f07eb8-6238-49ac-9c8f-d597c2c231ba', 'b087c6d9-9448-415f-ab42-4e1301ff2192', 'd057b705-ec6e-4c14-b560-1621a8a28440'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:53 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:53 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:53 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 1 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 2G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 2G" returned: 0 in 0.112s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.904s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fecf6f5-e426-4c81-9ba2-7c89c325a9c7,created_at=2026-07-09T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768478359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fecf6f5-e426-4c81-9ba2-7c89c325a9c7,host='devstack@QuobyteHD#QuobyteHD',id=a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c5c9817d01424a889bb69d95ac8033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:51Z,use_quota=True,user_id='1a436c752644469290a478e1b0687391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2899eea2-459d-4f12-941e-615059705ceb),volume_type_id=2899eea2-459d-4f12-941e-615059705ceb)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Creating volume a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:54:53 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:54:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:53 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 1073741824 Jul 09 02:54:53 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bf1753a6-4512-4fd0-a4dd-215dd86aad55 tempest-VolumesExtendTest-976434951 None] Extend volume completed successfully. Jul 09 02:54:54 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" returned: 0 in 0.993s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf789b6a-2083-437b-abf2-6f7244762101(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12efd4f-c98f-4ce5-862f-7e465d8cdf37]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:54 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 Jul 09 02:54:54 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:54 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.860s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Deleted volume successfully. Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-82805287-c4b9-491e-8194-0272d24f6cb5 tempest-VolumesSnapshotNegativeTestJSON-1020707100 None] Lock "cinder-35732fc3-9d89-4316-99c8-ef17900fe58c-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:54 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 1073741824" returned: 0 in 1.003s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:54 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 Jul 09 02:54:54 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:55 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101" returned: 0 in 0.892s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:55 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 Jul 09 02:54:55 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-6587648a-0cfb-43e5-9607-fef0a9190b56-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "cinder-6587648a-0cfb-43e5-9607-fef0a9190b56-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-quobyte-6587648a-0cfb-43e5-9607-fef0a9190b56" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-6587648a-0cfb-43e5-9607-fef0a9190b56" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[24483e8e-81a7-477d-89ac-22433faead9f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:55 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:55 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:55 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c66ac8-b634-405b-b439-af1c51acaa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9269a184-e502-47e7-bc35-78b776d1c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Volume volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 (a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79): created successfully Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9269a184-e502-47e7-bc35-78b776d1c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Flow 'volume_create_manager' (a87f0733-4851-408a-bc58-c87e3940e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-79fb3ab3-f713-4176-9dc7-2d0f2b507b5e tempest-GroupSnapshotsV319Test-1114627058 None] Created volume successfully. Jul 09 02:54:55 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" returned: 0 in 0.845s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:55 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8 Jul 09 02:54:55 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:56 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 0.905s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:56 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:56 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:56 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101.bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8" released by "_delete_snapshot" :: held 3.603s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" released by "delete_snapshot" :: held 3.635s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] GroupSnapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: creating. Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['6a15558d-6348-4ee7-9ac3-cfce674274cd', 'eed4237c-5d9a-4bd7-af2a-9ceeb38dd487', '8d71f66f-c497-4c1f-b33a-85e5edebaf30', '23fc1cd7-e6ed-48e1-b79f-6e63e6ebcfb7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Group snapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: creating. {{(pid=87156) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Creating offline snapshot 14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 of volume a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[13518909-b423-4b8a-a947-e7e0b463628c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Delete snapshot completed successfully. Jul 09 02:54:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f5f733be-7a96-4a7a-affc-9315d97a2b44 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-bd673e65-2aaa-41dc-ad4a-5293cf1d45b8-delete_snapshot" released by "delete_snapshot" :: held 3.936s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:57 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 Jul 09 02:54:57 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:57 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 1 in 0.829s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:57 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56 Jul 09 02:54:57 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:57 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:57 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 1G Jul 09 02:54:57 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:57 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6587648a-0cfb-43e5-9607-fef0a9190b56" returned: 0 in 0.791s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-6587648a-0cfb-43e5-9607-fef0a9190b56" released by "delete_volume" :: held 2.656s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Created reservations ['d27adabe-c871-4fc4-bf03-1505a415bdcb', 'a4da24db-a0b6-4917-848c-7a3ad7babcd5', '04d8ff17-3b09-4c20-8b9e-190e97f1b9f2', 'ffedeb69-0906-4fd4-9127-3cce4eccf827'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (27267586-e9c3-4818-9985-9ae6a443b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd16a2a-6d78-44b3-a425-65c8e5038951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd16a2a-6d78-44b3-a425-65c8e5038951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1825251253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b0f22-ded0-4404-be88-b818e28b3719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:58Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085b86b4-307d-4a00-bee6-1256df30f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085b86b4-307d-4a00-bee6-1256df30f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31eef56-6bda-4297-879b-9ca232b91527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31eef56-6bda-4297-879b-9ca232b91527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62b0f22-ded0-4404-be88-b818e28b3719', 'volume_name': 'volume-c62b0f22-ded0-4404-be88-b818e28b3719', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5989a21-bf3e-4878-9301-f7ed7ee09f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5989a21-bf3e-4878-9301-f7ed7ee09f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6932e6-95b2-4c5b-bd28-07861907a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:58 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Volume c62b0f22-ded0-4404-be88-b818e28b3719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62b0f22-ded0-4404-be88-b818e28b3719', 'volume_size': 1} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:58 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:54:58 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:58 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 1G" returned: 0 in 1.005s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:58 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 Jul 09 02:54:58 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:54:58 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.770s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:58 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:54:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Deleted volume successfully. Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c07cf570-9c47-41ac-8451-410cbbc58d63 tempest-VolumesExtendTest-976434951 None] Lock "cinder-6587648a-0cfb-43e5-9607-fef0a9190b56-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Flow 'volume_create_manager' (4f4c401e-4b6a-4787-8081-dc58ee311dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99335e33-2759-496c-85b2-9cf40af344fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99335e33-2759-496c-85b2-9cf40af344fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1646166499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24791bf2-25e5-4680-bdfb-a502b0af1753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b82ad409e35450db71afbefeae3f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:59Z,use_quota=True,user_id='dfafdf7cc8744c8499b0ecb33723384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16bb17b-61b8-4f61-b874-a14f12940165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16bb17b-61b8-4f61-b874-a14f12940165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaae771-d7ab-42cb-b024-27029db33f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaae771-d7ab-42cb-b024-27029db33f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24791bf2-25e5-4680-bdfb-a502b0af1753', 'volume_name': 'volume-24791bf2-25e5-4680-bdfb-a502b0af1753', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e235136c-8d99-42da-b6b9-adf08595ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e235136c-8d99-42da-b6b9-adf08595ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f1054b-504a-4aa0-a3c5-68aa382c07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:54:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Volume 24791bf2-25e5-4680-bdfb-a502b0af1753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24791bf2-25e5-4680-bdfb-a502b0af1753', 'volume_size': 1} Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:54:59 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:54:59 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:54:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:54:59 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 Jul 09 02:54:59 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:00 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" returned: 0 in 0.641s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:00 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info Jul 09 02:55:00 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:00 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info" returned: 0 in 0.671s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:00 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:55:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:00 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info Jul 09 02:55:00 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Flow 'volume_create_manager' (878751a4-8d5a-4ca5-9505-418a17029bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c19e7f-493a-4216-b9c9-df37acc9ab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c19e7f-493a-4216-b9c9-df37acc9ab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67d9e6287744f0c83480237dd07d07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:01Z,use_quota=True,user_id='d872f95802764cc0ac2c2925b9eb3def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb8b9a2-ed88-43fa-982b-8ed9e101b7f7),volume_type_id=0cb8b9a2-ed88-43fa-982b-8ed9e101b7f7)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be19a560-9ed5-480c-859a-07abfd783464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be19a560-9ed5-480c-859a-07abfd783464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86550fd4-4f73-444a-a206-b0ebeaaa8b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86550fd4-4f73-444a-a206-b0ebeaaa8b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d', 'volume_name': 'volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d', 'volume_size': 1, 'image_id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a02bf69a2276f748933ed686feace19f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b67d9e6287744f0c83480237dd07d07a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb798ee23ca9d877b39c4838b54391b565b8e2656b1601dd8a3de9dfcfacc376b6de96e620977e002caa96951f6f8fc52264508aa3fe0e7733390dd1e7278308', 'id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'created_at': datetime.datetime(2026, 7, 9, 0, 54, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55c1ae1-3725-437e-a0c3-c0fadd545e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55c1ae1-3725-437e-a0c3-c0fadd545e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225f1d7a-2565-4a5f-8651-2904a5ca72ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d', 'volume_size': 1, 'image_id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a02bf69a2276f748933ed686feace19f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b67d9e6287744f0c83480237dd07d07a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb798ee23ca9d877b39c4838b54391b565b8e2656b1601dd8a3de9dfcfacc376b6de96e620977e002caa96951f6f8fc52264508aa3fe0e7733390dd1e7278308', 'id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'created_at': datetime.datetime(2026, 7, 9, 0, 54, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Trying to clone d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d from image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 02:55:01 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.info" returned: 0 in 0.648s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.723s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.472s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1825251253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b0f22-ded0-4404-be88-b818e28b3719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:58Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Creating volume c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:01 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 02:55:01 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Image download 0.00 MB at 0.00 MB/s Jul 09 02:55:01 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 1073741824 Jul 09 02:55:01 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a1e1f-1fa1-450a-8caf-009124b17deb]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5e36f033-91f5-4436-8252-04c82a798127 tempest-GroupSnapshotsV319Test-1114627058 None] group_snapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: created successfully Jul 09 02:55:01 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:01 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:02 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:02 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:02 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:02 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 1073741824" returned: 0 in 0.990s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=168,cinder:INSERT=45,cinder:UPDATE=185,cinder:DELETE=13 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] group_snapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: deleting Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=167,cinder:INSERT=59,cinder:UPDATE=185,cinder:DELETE=8 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:55:02 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:02 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] group_snapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: deleting {{(pid=87156) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "cinder-quobyte-14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Deleting offline snapshot 14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 of volume a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] snapshot_file for this snap is: volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[366af6f6-3f80-4756-b918-1c94f005882e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:03 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 Jul 09 02:55:03 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:03 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 1 in 0.929s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Temporary image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 is fetched for user d872f95802764cc0ac2c2925b9eb3def. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 02:55:03 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f7616-7d3e-4612-a695-25cbf5d6ef12]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 0.815s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.293s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1646166499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24791bf2-25e5-4680-bdfb-a502b0af1753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b82ad409e35450db71afbefeae3f077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:54:59Z,use_quota=True,user_id='dfafdf7cc8744c8499b0ecb33723384b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Creating volume 24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:03 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6932e6-95b2-4c5b-bd28-07861907a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62b0f22-ded0-4404-be88-b818e28b3719', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:03 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 1073741824 Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af7d6e5-3fc8-4905-a28e-4f2172e61da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:03 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:03 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Volume volume-c62b0f22-ded0-4404-be88-b818e28b3719 (c62b0f22-ded0-4404-be88-b818e28b3719): created successfully Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af7d6e5-3fc8-4905-a28e-4f2172e61da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (27267586-e9c3-4818-9985-9ae6a443b437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-56dc8087-070f-4044-bcff-4e623f1ab96c tempest-VolumesSnapshotTestJSON-516389980 None] Created volume successfully. Jul 09 02:55:03 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:03 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:03 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" returned: 0 in 0.879s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410b640-b06a-489d-9bb3-8b1706cb7f1e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:03 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 Jul 09 02:55:03 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:04 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:04 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 1073741824" returned: 0 in 0.879s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:04 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:04 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:04 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:04 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:04 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:04 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 Jul 09 02:55:04 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:05 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 1 in 0.827s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:05 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 0.749s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.496s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Creating offline snapshot b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b of volume c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f1054b-504a-4aa0-a3c5-68aa382c07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24791bf2-25e5-4680-bdfb-a502b0af1753', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813af8ef-2ad4-4325-bafd-b23f886943b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af9639b-42c5-464c-8030-d217fe2f03e1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:05 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Volume volume-24791bf2-25e5-4680-bdfb-a502b0af1753 (24791bf2-25e5-4680-bdfb-a502b0af1753): created successfully Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813af8ef-2ad4-4325-bafd-b23f886943b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Flow 'volume_create_manager' (4f4c401e-4b6a-4787-8081-dc58ee311dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-527ad04d-bd74-41ed-a97c-0f1713647b9c tempest-VolumesExtendTest-976434951 None] Created volume successfully. Jul 09 02:55:05 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:05 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:05 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" returned: 0 in 0.863s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:05 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9 Jul 09 02:55:05 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:06 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 0.791s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:06 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b 1G Jul 09 02:55:06 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:06 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79.14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" returned: 0 in 0.680s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-14e3dc56-2fde-4c0d-8b7c-4b1bd2b013b9" released by "_delete_snapshot" :: held 3.412s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" released by "delete_snapshot" :: held 3.437s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:06 devstack cinder-volume[87156]: WARNING cinder.quota [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-79846141 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-79846141, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:06 devstack cinder-volume[87156]: WARNING cinder.quota [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-79846141 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-79846141, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] Created reservations ['d5bcfcec-80a2-444b-8ed3-3529f3a246f5', '7e27304a-ab0f-4f8b-a85a-e40cd38b1e04', '72768d77-a7b1-438b-bd95-f413d1d3c896', '6817c218-ff4f-477a-a83d-80c47d1c9220'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5e0e6f25-3699-4c83-8ce5-901f46d7b061 tempest-GroupSnapshotsV319Test-1114627058 None] group_snapshot cc6153b9-7f82-4f67-b957-030bf8cf1804: deleted successfully Jul 09 02:55:06 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b 1G" returned: 0 in 0.802s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b0f22-ded0-4404-be88-b818e28b3719 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:06 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b0f22-ded0-4404-be88-b818e28b3719 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:06 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[76635e15-6293-4006-9d93-acad95c88d3c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:07 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b0f22-ded0-4404-be88-b818e28b3719 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 0.714s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:07 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b is being set with open permissions: ugo+rw Jul 09 02:55:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:07 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:07 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:07 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 Jul 09 02:55:07 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:08 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 0.649s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:08 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" returned: 0 in 0.742s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:08 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79 Jul 09 02:55:08 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:08 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info Jul 09 02:55:08 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:08 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "cinder-quobyte-a13fd3f3-04dd-404b-8e1a-f2bd04ac3f79" released by "delete_volume" :: held 1.482s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Created reservations ['ef38767c-2f51-46cb-a1e6-912ffa07f59e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:08 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info" returned: 0 in 0.726s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:08 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info is being set with open permissions: ugo+rw Jul 09 02:55:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:08 devstack cinder-volume[87156]: WARNING cinder.quota [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-79846141 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-79846141, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:09 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info Jul 09 02:55:09 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Created reservations ['1280b24c-c67a-4253-be70-482ae01f486b', '5ccf8b1c-3fe8-48c7-8a1e-8e40daeb7cfb', '78cb2581-893d-4619-a88d-cf01831292d2', '03028597-8548-4c67-ad40-887663d1ed2b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:09 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:09 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:09 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.info" returned: 0 in 0.648s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67d9e6287744f0c83480237dd07d07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:01Z,use_quota=True,user_id='d872f95802764cc0ac2c2925b9eb3def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb8b9a2-ed88-43fa-982b-8ed9e101b7f7),volume_type_id=0cb8b9a2-ed88-43fa-982b-8ed9e101b7f7)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Creating volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:09 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:09 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1073741824 Jul 09 02:55:09 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c4747062-ece8-468f-b533-f0ea084a547f tempest-VolumesSnapshotTestJSON-516389980 None] Create snapshot completed successfully Jul 09 02:55:09 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.685s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:09 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a316fa7b-5eb0-435b-8aee-268951e7e9c5 tempest-GroupSnapshotsV319Test-1114627058 None] Delete group completed successfully. Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (aa165337-543e-4be0-962d-a56833753947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc11d5eb-7dbc-4b08-b571-982657dcc2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc11d5eb-7dbc-4b08-b571-982657dcc2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-986004589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:10Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c27adae-3dc6-4c0f-b4fe-47002a6d22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c27adae-3dc6-4c0f-b4fe-47002a6d22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e14ac-d112-4494-be6b-c3e900a32caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e14ac-d112-4494-be6b-c3e900a32caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd', 'volume_name': 'volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd', 'volume_size': 2, 'snapshot_id': 'b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05de2768-980e-40a2-806c-6c843c0483fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05de2768-980e-40a2-806c-6c843c0483fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa24398-ee9c-4cfd-8a75-d6dc9a6ab1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:10 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Volume c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd', 'volume_size': 2, 'snapshot_id': 'b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b'} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:10 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1073741824" returned: 0 in 1.030s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:10 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:10 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:11 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 0 in 0.754s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.793s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Creating offline snapshot 26f384fd-fb93-4df2-afed-d16d8eb42104 of volume 24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Attempting download of 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}])) to volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e193f172-270e-43ff-8d9e-2067719ff25f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8add42-7fb4-4533-8f26-ba8b40ff3362]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:11 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:11 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:11 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo Jul 09 02:55:11 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:12 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 0.934s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:12 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 1G Jul 09 02:55:12 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:12 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo" returned: 0 in 0.932s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:12 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo Jul 09 02:55:12 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:13 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo" returned: 1 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_cj3gndgo' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7fd96d-bbf7-49d6-a34e-9e31ba721a5f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:13 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 1G" returned: 0 in 1.006s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24791bf2-25e5-4680-bdfb-a502b0af1753 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:13 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:13 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:13 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24791bf2-25e5-4680-bdfb-a502b0af1753 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 Jul 09 02:55:13 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:14 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24791bf2-25e5-4680-bdfb-a502b0af1753 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104" returned: 0 in 0.728s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:14 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 is being set with open permissions: ugo+rw Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:14 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:14 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 Jul 09 02:55:14 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:14 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD Jul 09 02:55:14 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:14 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:14 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info Jul 09 02:55:14 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:15 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD" returned: 1 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 was raw, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:15 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:15 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0b932546-80c5-4e62-8de6-f2fd9083f8b8 tempest-GroupsV314Test-256030260 None] Group tempest-GroupsV314Test-Group-446544844: creating Jul 09 02:55:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0b932546-80c5-4e62-8de6-f2fd9083f8b8 tempest-GroupsV314Test-256030260 None] Group tempest-GroupsV314Test-Group-446544844: created successfully Jul 09 02:55:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0b932546-80c5-4e62-8de6-f2fd9083f8b8 tempest-GroupsV314Test-256030260 None] Create group completed successfully. Jul 09 02:55:15 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:15 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info is being set with open permissions: ugo+rw Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:15 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info Jul 09 02:55:15 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:15 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e6e9e23-0c63-4c86-80f5-31b9c23a5b21_a1ipsq2vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:55:15 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 02:55:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:15 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1G Jul 09 02:55:15 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:16 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.info" returned: 0 in 0.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.869s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.691s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Creating volume c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd from snapshot b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8ca1bfd2-d2de-4efa-919a-ce02205dc29d tempest-VolumesExtendTest-976434951 None] Create snapshot completed successfully Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] snapshot: b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b, volume: c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ad9be-e0e0-4fbf-9202-f56249ef3f4c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:16 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:16 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:16 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d 1G" returned: 0 in 0.799s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fbd83d-49e7-4e90-97f3-67ea8dafe0a4]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:16 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:16 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Flow 'volume_create_manager' (161d4e64-c04d-4dc0-a6ea-a7d0eb7e41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be28d49-1b12-43a2-881d-0e638b540b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be28d49-1b12-43a2-881d-0e638b540b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304421880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e0d8db-d291-4aec-89df-90d950fe1e05,host='devstack@QuobyteHD#QuobyteHD',id=b6c37ad6-d331-45c9-afa5-187451301e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3240cd2da0d342378284327499d70c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:17Z,use_quota=True,user_id='d8d15a8abacc4ed29a4818b1f1aae141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400bdaa8-d7e1-4c86-92e2-8386e5b4404a),volume_type_id=400bdaa8-d7e1-4c86-92e2-8386e5b4404a)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91346f20-259a-438b-b8b6-835259f27b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91346f20-259a-438b-b8b6-835259f27b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab566066-cdd7-4c48-84ef-15dcbaf56ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab566066-cdd7-4c48-84ef-15dcbaf56ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c37ad6-d331-45c9-afa5-187451301e9c', 'volume_name': 'volume-b6c37ad6-d331-45c9-afa5-187451301e9c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3977d043-e264-4cef-b773-ce8141900a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3977d043-e264-4cef-b773-ce8141900a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155cd1d8-5ff1-456b-9caf-f5549c781296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Volume b6c37ad6-d331-45c9-afa5-187451301e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c37ad6-d331-45c9-afa5-187451301e9c', 'volume_size': 1} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:17 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 0.939s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62b0f22-ded0-4404-be88-b818e28b3719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbdf3bd-834c-4896-80c9-798c9b932d3e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:17 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:17 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:17 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 0 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:17 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:17 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:18 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 0.933s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:18 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd Jul 09 02:55:18 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:18 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 1 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Downloaded image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}])) to volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Temporary image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 for user d872f95802764cc0ac2c2925b9eb3def is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Marking volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Copying metadata from image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 to d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Creating volume glance metadata for volume d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d backed by image 6e6e9e23-0c63-4c86-80f5-31b9c23a5b21 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a02bf69a2276f748933ed686feace19f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225f1d7a-2565-4a5f-8651-2904a5ca72ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d', 'volume_size': 1, 'image_id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a02bf69a2276f748933ed686feace19f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b67d9e6287744f0c83480237dd07d07a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb798ee23ca9d877b39c4838b54391b565b8e2656b1601dd8a3de9dfcfacc376b6de96e620977e002caa96951f6f8fc52264508aa3fe0e7733390dd1e7278308', 'id': '6e6e9e23-0c63-4c86-80f5-31b9c23a5b21', 'created_at': datetime.datetime(2026, 7, 9, 0, 54, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6e9e23-0c63-4c86-80f5-31b9c23a5b21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0a6e1-463d-4362-8436-5bda137ae51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Volume volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d (d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d): created successfully Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d0a6e1-463d-4362-8436-5bda137ae51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Flow 'volume_create_manager' (878751a4-8d5a-4ca5-9505-418a17029bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6dd8ce0e-15fd-46f0-9e4d-2637d3cc4c05 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Created volume successfully. Jul 09 02:55:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Acquiring lock "cinder-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "cinder-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Acquiring lock "cinder-quobyte-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "cinder-quobyte-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86a66c-bde4-4851-b6ca-1b9764ea09b7]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:20 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:20 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:22 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 0 in 2.595s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:22 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:22 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:23 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" returned: 0 in 5.237s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804c4b4-174f-4c21-9e66-8f154279a953]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:23 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:23 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:23 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 1 in 1.129s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:55:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:23 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d Jul 09 02:55:23 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:24 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" returned: 0 in 0.710s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "cinder-quobyte-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d" released by "delete_volume" :: held 4.585s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:24 devstack cinder-volume[87156]: WARNING cinder.quota [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:24 devstack cinder-volume[87156]: WARNING cinder.quota [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Created reservations ['0b233584-f6dd-4107-a11c-706bfa97bc23', '0dd85ff0-3e2a-4570-9331-6d36aeafc492', '18851cba-4ceb-4f4d-831c-00080e9572cc', 'eeb8275d-edb4-4f24-8d1f-2203480920e7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:24 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 1.016s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:55:24 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Converted 1024.00 MB image at 195.49 MB/s Jul 09 02:55:24 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd is being set with open permissions: ugo+rw Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:24 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd Jul 09 02:55:24 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:24 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:24 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:25 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" returned: 0 in 0.695s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" released by "_copy_volume_from_snapshot" :: held 8.943s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" released by "_create_volume_from_snapshot" :: held 8.991s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.025s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.208s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3e0d8db-d291-4aec-89df-90d950fe1e05,created_at=2026-07-09T00:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1304421880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e0d8db-d291-4aec-89df-90d950fe1e05,host='devstack@QuobyteHD#QuobyteHD',id=b6c37ad6-d331-45c9-afa5-187451301e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3240cd2da0d342378284327499d70c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:17Z,use_quota=True,user_id='d8d15a8abacc4ed29a4818b1f1aae141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400bdaa8-d7e1-4c86-92e2-8386e5b4404a),volume_type_id=400bdaa8-d7e1-4c86-92e2-8386e5b4404a)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Creating volume b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:25 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:25 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c 1073741824 Jul 09 02:55:25 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:25 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.719s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa24398-ee9c-4cfd-8a75-d6dc9a6ab1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd', 'volume_size': 2, 'snapshot_id': 'b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cffe53-8a3e-4069-a160-8810da3a5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Deleted volume successfully. Jul 09 02:55:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Volume volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd (c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd): created successfully Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cffe53-8a3e-4069-a160-8810da3a5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (aa165337-543e-4be0-962d-a56833753947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0ae30646-4e93-4e3a-9a64-0125da5f9301 tempest-VolumeAndVolumeTypeFromImageTest-423487439 None] Lock "cinder-d1ddeeaa-80ea-4991-8cd7-4d6c49c12e9d-delete_volume" released by "delete_volume" :: held 5.636s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8eb702ca-8f90-41ad-93c0-2e309f81c56e tempest-VolumesSnapshotTestJSON-516389980 None] Created volume successfully. Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9019e81e-f6e9-49ca-a751-efce4d0e4ebc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:26 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd Jul 09 02:55:26 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:26 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c 1073741824" returned: 0 in 1.064s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:26 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:26 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:26 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" returned: 0 in 0.851s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:26 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd Jul 09 02:55:26 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:27 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.722s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.899s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155cd1d8-5ff1-456b-9caf-f5549c781296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c37ad6-d331-45c9-afa5-187451301e9c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e558792-921e-4e9a-959a-21fd4cbb24d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00168f3-add9-4798-ac7f-d24fcd7869be]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Volume volume-b6c37ad6-d331-45c9-afa5-187451301e9c (b6c37ad6-d331-45c9-afa5-187451301e9c): created successfully Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e558792-921e-4e9a-959a-21fd4cbb24d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Flow 'volume_create_manager' (161d4e64-c04d-4dc0-a6ea-a7d0eb7e41ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e3c5e855-aec4-4868-921a-72ee7817ce2a tempest-GroupsV314Test-256030260 None] Created volume successfully. Jul 09 02:55:27 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:27 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:27 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd" released by "delete_volume" :: held 1.731s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['e383ace7-f85d-4bc4-b60f-6ec4518dd4ae', 'cc6df86f-4d32-46ef-9a24-72492c59b95a', 'd9c7542f-e401-469b-92e6-2473cdc19259', '674409eb-e592-4391-846b-f58070558841'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:27 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:27 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:27 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:27 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Deleting offline snapshot b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b of volume c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] snapshot_file for this snap is: volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef3c77-77d0-41da-a849-57dbee84ebfa]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:28 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 1.451s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 2G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:28 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:28 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:29 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.180s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Deleted volume successfully. Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 2G" returned: 0 in 0.313s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.876s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdb8417e-61dd-4a91-85e4-a651466d666b tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-c4680ac8-a3f2-4528-b4e4-ccc3f39d93cd-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:29 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c26ac5e5-b385-4790-a26e-faf5c1bdaf4d tempest-VolumesExtendTest-976434951 None] Extend volume completed successfully. Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.276s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:55:29 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 1.065s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62b0f22-ded0-4404-be88-b818e28b3719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84216a86-835f-4db2-b8d8-abd8f3b7809c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:29 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:29 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-26f384fd-fb93-4df2-afed-d16d8eb42104-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-26f384fd-fb93-4df2-afed-d16d8eb42104-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-quobyte-26f384fd-fb93-4df2-afed-d16d8eb42104" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-26f384fd-fb93-4df2-afed-d16d8eb42104" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Deleting offline snapshot 26f384fd-fb93-4df2-afed-d16d8eb42104 of volume 24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] snapshot_file for this snap is: volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15215f5-b802-4923-952c-a2f6875ed385]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:30 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Cloning volume b6c37ad6-d331-45c9-afa5-187451301e9c to volume d16d70ee-bce4-4b41-83bf-4e51bdd81733 Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Creating offline snapshot 06839420-52e8-4863-92d4-a09bc44145d6 of volume b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:55:30 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 Jul 09 02:55:30 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05d223-f2b4-4c4e-bb78-62d53492ee96]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:30 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:30 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:30 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 1.145s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:31 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:31 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:31 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104" returned: 0 in 0.929s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24791bf2-25e5-4680-bdfb-a502b0af1753(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b1f6c6-be29-4112-9115-65a286794bff]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:31 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:31 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:31 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 1.172s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:31 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 1G Jul 09 02:55:31 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:32 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 1.060s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:32 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b Jul 09 02:55:32 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (74c22f72-b766-4c37-a717-326c650e87eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:32 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33af1a4b-0347-484e-802b-277c0ba66aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 1.108s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33af1a4b-0347-484e-802b-277c0ba66aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309472928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8fa3c2-ba3e-4980-809c-513336251478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:32Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 Jul 09 02:55:32 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe3ce47-e553-4b0d-9bf1-53b25f313e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe3ce47-e553-4b0d-9bf1-53b25f313e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea67bd-583d-4a42-b688-0eb728c782d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea67bd-583d-4a42-b688-0eb728c782d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8fa3c2-ba3e-4980-809c-513336251478', 'volume_name': 'volume-7b8fa3c2-ba3e-4980-809c-513336251478', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3da3b40-58da-4804-bf98-76752b068fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3da3b40-58da-4804-bf98-76752b068fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf3c36b-af96-494f-a1f1-0f02b47495e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Volume 7b8fa3c2-ba3e-4980-809c-513336251478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8fa3c2-ba3e-4980-809c-513336251478', 'volume_size': 1} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:32 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 1G" returned: 0 in 1.249s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c37ad6-d331-45c9-afa5-187451301e9c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:32 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c37ad6-d331-45c9-afa5-187451301e9c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:32 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:32 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (2133f22d-2efe-4d14-8ca7-912953dcfb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fbb8d9-471b-4e59-a43d-cb39fad1c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719.b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" returned: 0 in 0.879s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fbb8d9-471b-4e59-a43d-cb39fad1c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933269953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143f813c-2499-4b1c-a764-2883e3f8d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:33Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51de0ee-2322-45a2-afd4-2b4c1663b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51de0ee-2322-45a2-afd4-2b4c1663b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989576a-feb6-435d-88d3-c8414d01115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989576a-feb6-435d-88d3-c8414d01115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143f813c-2499-4b1c-a764-2883e3f8d4b3', 'volume_name': 'volume-143f813c-2499-4b1c-a764-2883e3f8d4b3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bf4e64-62b9-418a-af15-35b2627892c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bf4e64-62b9-418a-af15-35b2627892c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1501ac-4394-41a2-8b23-66460d00176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:32 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Volume 143f813c-2499-4b1c-a764-2883e3f8d4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143f813c-2499-4b1c-a764-2883e3f8d4b3', 'volume_size': 1} Jul 09 02:55:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b" released by "_delete_snapshot" :: held 4.392s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" released by "delete_snapshot" :: held 4.440s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['e9b9512e-f70e-4b14-96c5-58f266a52139', '442a8fbb-f932-40e6-b20f-449f05fa2c9c', 'bd39c57a-0ffc-4c6a-b925-e987ee0bbfaa', '9ac62011-1cec-44e2-a638-c8f8d43ae3b6'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:33 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Delete snapshot completed successfully. Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0bcc9b89-a3e1-4c21-925d-7d504e7a97d3 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-b9a8a55a-7ade-47f0-ba7b-f78752cd2c0b-delete_snapshot" released by "delete_snapshot" :: held 4.795s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (89df00c9-4d6a-4095-aad8-1ad7405cca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbed62c6-9eaf-4f92-a004-78f0df11e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbed62c6-9eaf-4f92-a004-78f0df11e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759832081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5b6107-b801-46c7-acb2-5fe6d226399c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:33Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc09fc1f-5c3f-4f69-95a5-5f2f15c9c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc09fc1f-5c3f-4f69-95a5-5f2f15c9c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1992f164-5c8e-4728-9567-3008bd64a390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1992f164-5c8e-4728-9567-3008bd64a390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5b6107-b801-46c7-acb2-5fe6d226399c', 'volume_name': 'volume-9b5b6107-b801-46c7-acb2-5fe6d226399c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff8fd0f-239f-494e-9ac9-587a58f07769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff8fd0f-239f-494e-9ac9-587a58f07769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0e11e7-bbc8-46c3-a884-66995fdd5b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Volume 9b5b6107-b801-46c7-acb2-5fe6d226399c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5b6107-b801-46c7-acb2-5fe6d226399c', 'volume_size': 1} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:33 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104" returned: 0 in 1.179s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:33 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104 Jul 09 02:55:33 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:33 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (7c806a79-4dfc-4311-bfa8-8fe405a18a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b816c0a-1d95-4ea6-aee1-5da0a9ccf958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c37ad6-d331-45c9-afa5-187451301e9c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 1.091s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:33 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:33 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b816c0a-1d95-4ea6-aee1-5da0a9ccf958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547479289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f01047-2583-4958-aafa-5ab151508796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:34Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad517371-d7a8-4bb0-8575-79ca26fded42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad517371-d7a8-4bb0-8575-79ca26fded42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7757a98e-e5d7-4924-b57c-d44446fddb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7757a98e-e5d7-4924-b57c-d44446fddb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f01047-2583-4958-aafa-5ab151508796', 'volume_name': 'volume-36f01047-2583-4958-aafa-5ab151508796', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e052c7c7-ac8f-46ac-b102-26189c653a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e052c7c7-ac8f-46ac-b102-26189c653a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db6f15c-e41d-4aa0-9381-45548a831660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:33 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Volume 36f01047-2583-4958-aafa-5ab151508796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f01047-2583-4958-aafa-5ab151508796', 'volume_size': 1} Jul 09 02:55:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (336cbc08-6757-4ff1-9dde-fc6d122b69e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db14363-44f5-4bcc-818f-5b6a2b4b63b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db14363-44f5-4bcc-818f-5b6a2b4b63b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1625268236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9124e6d-240e-4936-bdef-4b33ff5a6df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:34Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb02745-ec9d-4a8c-a5fc-0e9fd55f6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb02745-ec9d-4a8c-a5fc-0e9fd55f6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a62dd2-1398-4e51-9b0c-d89002ff9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a62dd2-1398-4e51-9b0c-d89002ff9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9124e6d-240e-4936-bdef-4b33ff5a6df8', 'volume_name': 'volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c517e85-f048-4700-b404-2c58d350d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:34 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c517e85-f048-4700-b404-2c58d350d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26746270-080b-4b22-842d-de55940467dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:34 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Volume e9124e6d-240e-4936-bdef-4b33ff5a6df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8', 'volume_size': 1} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-c62b0f22-ded0-4404-be88-b818e28b3719-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753.26f384fd-fb93-4df2-afed-d16d8eb42104" returned: 0 in 0.868s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-c62b0f22-ded0-4404-be88-b818e28b3719-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-26f384fd-fb93-4df2-afed-d16d8eb42104" released by "_delete_snapshot" :: held 4.269s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" released by "delete_snapshot" :: held 4.324s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb749b5a-0276-4d53-92f1-1f03ddb95c40]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Created reservations ['cf7e835f-662a-45aa-b612-82b9c3a27bb8', '089fc463-2636-46bc-82a6-c6e8ef96c4ed', '37143408-2d5a-443a-8329-6a98d68a4f6c', '52ab604a-0c6b-40f9-ad23-2a0d14a02329'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Delete snapshot completed successfully. Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-da9cafbb-0f9b-433d-b09a-91a839a207ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-26f384fd-fb93-4df2-afed-d16d8eb42104-delete_snapshot" released by "delete_snapshot" :: held 4.562s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:34 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:34 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:34 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 0.841s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:34 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info Jul 09 02:55:34 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:35 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 0.772s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:35 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719 Jul 09 02:55:35 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:35 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info" returned: 0 in 0.719s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:35 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:35 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info Jul 09 02:55:35 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-24791bf2-25e5-4680-bdfb-a502b0af1753-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-24791bf2-25e5-4680-bdfb-a502b0af1753-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b3398e-fe40-4ec8-802d-56412d004c94]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:35 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:35 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:36 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c62b0f22-ded0-4404-be88-b818e28b3719" returned: 0 in 0.798s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-c62b0f22-ded0-4404-be88-b818e28b3719" released by "delete_volume" :: held 1.638s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['d060f0ec-7456-46ce-9fc1-4ea454aea075', '1fca2dda-14e2-4fb8-a73e-a9c5177c3d1a', '1bd31375-32d9-4830-aca4-93c8caeb0613', '406941f2-78ea-4c2a-a6b3-6d943fdf4481'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:36 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.info" returned: 0 in 0.749s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Acquiring lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] snapshot: 06839420-52e8-4863-92d4-a09bc44145d6, volume: d16d70ee-bce4-4b41-83bf-4e51bdd81733, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58c7d1-67ce-4b81-84da-3200092865f1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:36 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:36 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:36 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:36 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:36 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 0.774s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:36 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753 Jul 09 02:55:36 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:37 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.737s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Deleted volume successfully. Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-718b8b79-0f70-465a-854c-8e05fb6daf56 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-c62b0f22-ded0-4404-be88-b818e28b3719-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:37 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 0.877s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c37ad6-d331-45c9-afa5-187451301e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5fd03-8a79-4d35-b128-f46185765786]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:37 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:37 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:37 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (858f5621-9ae4-474e-a206-463cd016254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af77d06-4d30-4f45-8a4c-6ff6a5fcfec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24791bf2-25e5-4680-bdfb-a502b0af1753" returned: 0 in 0.905s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af77d06-4d30-4f45-8a4c-6ff6a5fcfec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817357259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce118acd-042d-4110-89a5-e4ca0fa9d038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:37Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c7d1a6-e583-4e8a-9ba1-60d33ad334f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c7d1a6-e583-4e8a-9ba1-60d33ad334f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb599b58-108e-48e5-b414-b6b2f8c3d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb599b58-108e-48e5-b414-b6b2f8c3d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce118acd-042d-4110-89a5-e4ca0fa9d038', 'volume_name': 'volume-ce118acd-042d-4110-89a5-e4ca0fa9d038', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94040ede-85fa-435f-9aaa-18946be7f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94040ede-85fa-435f-9aaa-18946be7f209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906dfa16-02da-4f25-afd9-e63c5971564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Volume ce118acd-042d-4110-89a5-e4ca0fa9d038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce118acd-042d-4110-89a5-e4ca0fa9d038', 'volume_size': 1} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-quobyte-24791bf2-25e5-4680-bdfb-a502b0af1753" released by "delete_volume" :: held 1.787s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Created reservations ['17d124ba-c7ad-4c8f-af6b-42e36fc32887', '7082164e-e4dd-49d9-b264-fc3f4eeff9ed', 'd47c828e-a106-49ef-9ddf-d31551c7dc28', 'df9b8d58-33bb-4791-b3a7-a8813f735432'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:37 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:37 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:38 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.922s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:38 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 Jul 09 02:55:38 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:38 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Deleted volume successfully. Jul 09 02:55:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf76d324-2b2d-4ca1-bdcf-59010348a9ba tempest-VolumesExtendTest-976434951 None] Lock "cinder-24791bf2-25e5-4680-bdfb-a502b0af1753-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:43 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733" returned: 0 in 5.333s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17e583c-3971-4fa7-ac13-e57d190f83d4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (eaaf9ec5-b251-45d4-8009-c44fce6fd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:43 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:43 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80c692-7086-448c-a91e-f97609e56ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80c692-7086-448c-a91e-f97609e56ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-318069750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865cd180-be75-49d0-9dc3-839cb56078cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:44Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79e25f6-0eee-49fc-9ab9-8af2fc414787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79e25f6-0eee-49fc-9ab9-8af2fc414787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cfb389-29e9-4ad3-a437-d671b8a18c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cfb389-29e9-4ad3-a437-d671b8a18c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865cd180-be75-49d0-9dc3-839cb56078cb', 'volume_name': 'volume-865cd180-be75-49d0-9dc3-839cb56078cb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77673c44-ac2b-4264-8487-d1a1a1b31d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77673c44-ac2b-4264-8487-d1a1a1b31d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446bcbc7-d036-4dff-8d70-4df88f6a748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Volume 865cd180-be75-49d0-9dc3-839cb56078cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865cd180-be75-49d0-9dc3-839cb56078cb', 'volume_size': 1} Jul 09 02:55:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:44 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.964s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:44 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:55:44 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Converted 1024.00 MB image at 191.99 MB/s Jul 09 02:55:44 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 02:55:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:44 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 Jul 09 02:55:44 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:45 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733" returned: 0 in 0.603s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" released by "_copy_volume_from_snapshot" :: held 8.813s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Acquiring lock "cinder-quobyte-06839420-52e8-4863-92d4-a09bc44145d6" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-06839420-52e8-4863-92d4-a09bc44145d6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Deleting offline snapshot 06839420-52e8-4863-92d4-a09bc44145d6 of volume b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] snapshot_file for this snap is: volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[98710236-58b5-427d-864f-581180c616f1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:45 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:45 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:45 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 0.857s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c37ad6-d331-45c9-afa5-187451301e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:55:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb7d68-9733-4a71-aacd-61a0982accb5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:46 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:46 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:46 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.786s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:46 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:46 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:47 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 0.709s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:47 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6 Jul 09 02:55:47 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:48 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c.06839420-52e8-4863-92d4-a09bc44145d6" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-06839420-52e8-4863-92d4-a09bc44145d6" released by "_delete_snapshot" :: held 3.095s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.948s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.844s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309472928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8fa3c2-ba3e-4980-809c-513336251478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:32Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Creating volume 7b8fa3c2-ba3e-4980-809c-513336251478 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:48 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 1073741824 Jul 09 02:55:48 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2eeee367-1770-43a4-99ed-c75a304ecee5 tempest-GroupsV314Test-256030260 None] Create group from source-group-c3e0d8db-d291-4aec-89df-90d950fe1e05 completed successfully. Jul 09 02:55:49 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 1073741824" returned: 0 in 0.909s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:49 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 Jul 09 02:55:49 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Acquiring lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1326dc4-f4e0-4c5a-a7e5-65b48e2345b9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:49 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 Jul 09 02:55:49 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:49 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478" returned: 0 in 0.689s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.877s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933269953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143f813c-2499-4b1c-a764-2883e3f8d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:33Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Creating volume 143f813c-2499-4b1c-a764-2883e3f8d4b3 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:49 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf3c36b-af96-494f-a1f1-0f02b47495e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8fa3c2-ba3e-4980-809c-513336251478', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:49 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 1073741824 Jul 09 02:55:49 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050dc0e0-9689-4010-b28d-a395aad13545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Volume volume-7b8fa3c2-ba3e-4980-809c-513336251478 (7b8fa3c2-ba3e-4980-809c-513336251478): created successfully Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050dc0e0-9689-4010-b28d-a395aad13545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (74c22f72-b766-4c37-a717-326c650e87eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f76ef12e-e6ee-4594-ab7f-765bf0e86632 tempest-CreateVolumesFromImageTest-39645982 None] Created volume successfully. Jul 09 02:55:50 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733" returned: 0 in 0.788s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:50 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733 Jul 09 02:55:50 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:50 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 1073741824" returned: 0 in 0.845s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:50 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 Jul 09 02:55:50 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:51 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d16d70ee-bce4-4b41-83bf-4e51bdd81733" returned: 0 in 0.711s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-d16d70ee-bce4-4b41-83bf-4e51bdd81733" released by "delete_volume" :: held 1.546s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Created reservations ['c87da67c-1bd2-4316-a903-0aa8adb4d14a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:51 devstack cinder-volume[87156]: WARNING cinder.quota [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-779157423 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-779157423, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:51 devstack cinder-volume[87156]: WARNING cinder.quota [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-779157423 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-779157423, it is now deprecated. Please use the default quota class for default quota. Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Created reservations ['bf4e7e99-ef25-4ba6-bd14-5ae6d28a0315', 'e3fdb947-352f-4e0d-91b7-4adad5a3d19c', 'a41ca376-f972-49f0-abec-738839d37685', '79009479-7ff5-4170-a387-7b7b733591da'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:51 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:51 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:51 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.999s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759832081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5b6107-b801-46c7-acb2-5fe6d226399c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:33Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Creating volume 9b5b6107-b801-46c7-acb2-5fe6d226399c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:51 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1501ac-4394-41a2-8b23-66460d00176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143f813c-2499-4b1c-a764-2883e3f8d4b3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41739c7-8356-4404-ae66-2a1fd78ef786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:51 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c 1073741824 Jul 09 02:55:51 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Volume volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 (143f813c-2499-4b1c-a764-2883e3f8d4b3): created successfully Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41739c7-8356-4404-ae66-2a1fd78ef786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (2133f22d-2efe-4d14-8ca7-912953dcfb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-22d43e84-2925-4d34-b4f0-5edccfdcb68e tempest-CreateVolumesFromImageTest-39645982 None] Created volume successfully. Jul 09 02:55:51 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.707s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:51 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1840722c-1ae8-45d4-b1ae-1aa1d50e898c tempest-GroupsV314Test-256030260 None] Delete group completed successfully. Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Acquiring lock "cinder-quobyte-b6c37ad6-d331-45c9-afa5-187451301e9c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-b6c37ad6-d331-45c9-afa5-187451301e9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c3654-b12c-4da3-9f10-b1256b6b58c7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:52 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:52 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:52 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c 1073741824" returned: 0 in 0.876s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:52 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c Jul 09 02:55:52 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:52 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:52 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c Jul 09 02:55:52 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:53 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.090s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547479289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f01047-2583-4958-aafa-5ab151508796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:34Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Creating volume 36f01047-2583-4958-aafa-5ab151508796 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:53 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:53 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 1073741824 Jul 09 02:55:53 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0e11e7-bbc8-46c3-a884-66995fdd5b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5b6107-b801-46c7-acb2-5fe6d226399c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1f79ce-569d-4e6d-b040-d9346ad4c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Volume volume-9b5b6107-b801-46c7-acb2-5fe6d226399c (9b5b6107-b801-46c7-acb2-5fe6d226399c): created successfully Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1f79ce-569d-4e6d-b040-d9346ad4c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (89df00c9-4d6a-4095-aad8-1ad7405cca0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b3a1e523-d301-4f60-a6c6-51ed6893713b tempest-CreateVolumesFromImageTest-39645982 None] Created volume successfully. Jul 09 02:55:53 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b6c37ad6-d331-45c9-afa5-187451301e9c" returned: 0 in 0.697s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Lock "cinder-quobyte-b6c37ad6-d331-45c9-afa5-187451301e9c" released by "delete_volume" :: held 1.545s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Created reservations ['68e76266-b237-4826-acb2-2a46e0528a4f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Created reservations ['2c20a15f-6d93-4a3c-8f1b-b12decb255fc', 'e429e637-dabe-4ed1-8344-c630536ed273', '8f85bdba-27bd-49ae-99c6-221166b03c4d', 'da2e2632-89aa-441c-819b-cf0c148a0fc2'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:53 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 1073741824" returned: 0 in 0.876s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:53 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:53 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:53 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 Jul 09 02:55:53 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:54 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:54 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796" returned: 0 in 0.652s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.294s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1625268236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9124e6d-240e-4936-bdef-4b33ff5a6df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4919eefccea94c7ea69fc0e754700c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:34Z,use_quota=True,user_id='f847141c883a4835b35ae7381bdb238a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Creating volume e9124e6d-240e-4936-bdef-4b33ff5a6df8 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:54 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-113cbc04-d666-42fb-842a-1c121ab2b4ad tempest-GroupsV314Test-256030260 None] Delete group completed successfully. Jul 09 02:55:54 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 1073741824 Jul 09 02:55:54 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db6f15c-e41d-4aa0-9381-45548a831660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f01047-2583-4958-aafa-5ab151508796', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bc3352-6132-49a2-8365-2fb9788b2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Volume volume-36f01047-2583-4958-aafa-5ab151508796 (36f01047-2583-4958-aafa-5ab151508796): created successfully Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bc3352-6132-49a2-8365-2fb9788b2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (7c806a79-4dfc-4311-bfa8-8fe405a18a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8f5c4793-6b37-417c-a805-e91787e82ca9 tempest-CreateVolumesFromImageTest-39645982 None] Created volume successfully. Jul 09 02:55:55 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 1073741824" returned: 0 in 0.883s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:55 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 Jul 09 02:55:55 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:56 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8" returned: 0 in 0.669s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.752s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817357259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce118acd-042d-4110-89a5-e4ca0fa9d038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:37Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Creating volume ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:56 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26746270-080b-4b22-842d-de55940467dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:56 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 1073741824 Jul 09 02:55:56 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3a742c-e6e1-4bc3-b79e-87302e89d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Volume volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 (e9124e6d-240e-4936-bdef-4b33ff5a6df8): created successfully Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3a742c-e6e1-4bc3-b79e-87302e89d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Flow 'volume_create_manager' (336cbc08-6757-4ff1-9dde-fc6d122b69e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-041fd054-ca0c-4800-8051-761670857022 tempest-CreateVolumesFromImageTest-39645982 None] Created volume successfully. Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-e9124e6d-240e-4936-bdef-4b33ff5a6df8-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-e9124e6d-240e-4936-bdef-4b33ff5a6df8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-quobyte-e9124e6d-240e-4936-bdef-4b33ff5a6df8" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-e9124e6d-240e-4936-bdef-4b33ff5a6df8" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69a5f30-30be-4063-b485-43d156a73fe0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:56 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 Jul 09 02:55:56 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:57 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 1073741824" returned: 0 in 0.960s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:57 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:55:57 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:57 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:57 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8 Jul 09 02:55:57 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:57 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 0.707s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.254s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-318069750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865cd180-be75-49d0-9dc3-839cb56078cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:55:44Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Creating volume 865cd180-be75-49d0-9dc3-839cb56078cb {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:55:57 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:57 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb 1073741824 Jul 09 02:55:57 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906dfa16-02da-4f25-afd9-e63c5971564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce118acd-042d-4110-89a5-e4ca0fa9d038', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b6cdec-f2f0-4e9d-8a07-cea866df3354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:58 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Volume volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 (ce118acd-042d-4110-89a5-e4ca0fa9d038): created successfully Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b6cdec-f2f0-4e9d-8a07-cea866df3354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (858f5621-9ae4-474e-a206-463cd016254b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-524136e2-4686-47ee-8ca6-4793dc71ff8d tempest-VolumesSnapshotTestJSON-516389980 None] Created volume successfully. Jul 09 02:55:58 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9124e6d-240e-4936-bdef-4b33ff5a6df8" returned: 0 in 0.740s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-e9124e6d-240e-4936-bdef-4b33ff5a6df8" released by "delete_volume" :: held 1.634s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Created reservations ['cea9de63-12ae-402e-837a-64882bdd86fe', '89a53cf3-aab4-454b-9e5f-656f4b128635', 'f2bff062-0fab-4f55-9f2c-d405e1906f87', 'd0d930c3-ffa3-4e29-99e5-ff18669de1e7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:58 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:55:58 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-36f01047-2583-4958-aafa-5ab151508796-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-36f01047-2583-4958-aafa-5ab151508796-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-quobyte-36f01047-2583-4958-aafa-5ab151508796" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-36f01047-2583-4958-aafa-5ab151508796" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:55:59 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb 1073741824" returned: 0 in 1.085s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[342a5af1-aed5-4169-899d-4beb8b1ad764]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:59 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb Jul 09 02:55:59 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:59 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 Jul 09 02:55:59 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:59 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.798s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:55:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Deleted volume successfully. Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1473c25e-ace5-4dac-9545-2d948f790820 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-e9124e6d-240e-4936-bdef-4b33ff5a6df8-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:55:59 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796" returned: 0 in 0.807s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb" returned: 0 in 0.773s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.187s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:55:59 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796 Jul 09 02:55:59 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446bcbc7-d036-4dff-8d70-4df88f6a748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865cd180-be75-49d0-9dc3-839cb56078cb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d444ee90-ba68-4c57-9dd4-17655f028d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Creating offline snapshot 984821c0-0167-4f10-a318-c2e6c3049dcd of volume ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:55:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Volume volume-865cd180-be75-49d0-9dc3-839cb56078cb (865cd180-be75-49d0-9dc3-839cb56078cb): created successfully Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d444ee90-ba68-4c57-9dd4-17655f028d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (eaaf9ec5-b251-45d4-8009-c44fce6fd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[040cb7b9-441a-4c64-a83e-fb3e9dc6809c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:55:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:55:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bc19f32e-b0ee-4343-83e1-2aa08f6d92b6 tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:56:00 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:00 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:00 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-36f01047-2583-4958-aafa-5ab151508796" returned: 0 in 0.713s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-36f01047-2583-4958-aafa-5ab151508796" released by "delete_volume" :: held 1.585s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Created reservations ['0a11d2a4-e36f-4573-9f01-d8279e753513', '1a5a980d-7e9c-4d40-ae78-35545e5af462', '2e4efba6-ebd0-4fcb-9685-29244be36331', 'f9837a36-d5be-494f-8cb1-5c44c87aa3bd'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:00 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:00 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:00 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 0.845s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:00 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd 1G Jul 09 02:56:00 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-9b5b6107-b801-46c7-acb2-5fe6d226399c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-9b5b6107-b801-46c7-acb2-5fe6d226399c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-quobyte-9b5b6107-b801-46c7-acb2-5fe6d226399c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-9b5b6107-b801-46c7-acb2-5fe6d226399c" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d4677-f41c-4e20-bfb5-6fba418ff5e6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:01 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c Jul 09 02:56:01 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:01 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Deleted volume successfully. Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (9691cb5b-4bda-4bf0-be1e-27d337afe1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd083b1-7541-48db-b54b-22926aa71f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd083b1-7541-48db-b54b-22926aa71f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-443014072',display_name='tempest-VolumesGetTest-Volume-541699197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04ce4a8-5eba-499c-8e9e-f5de4daee55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:01Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b446850-f748-4707-ae77-d105bdb04451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b446850-f748-4707-ae77-d105bdb04451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb31dd99-9300-49b8-ba4f-3e35bb2825a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb31dd99-9300-49b8-ba4f-3e35bb2825a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04ce4a8-5eba-499c-8e9e-f5de4daee55e', 'volume_name': 'volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117431ae-ffc8-4c8d-bcb2-f2b52e13d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117431ae-ffc8-4c8d-bcb2-f2b52e13d58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c29cea6-3134-4ab4-b720-fb07bdde676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Volume f04ce4a8-5eba-499c-8e9e-f5de4daee55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e', 'volume_size': 1} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f931bfa4-5365-433e-8a03-cfee1b0d6b8c tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-36f01047-2583-4958-aafa-5ab151508796-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:01 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd 1G" returned: 0 in 1.139s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:01 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:01 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:02 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c" returned: 0 in 0.916s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:02 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c Jul 09 02:56:02 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:02 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.835s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:02 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd is being set with open permissions: ugo+rw Jul 09 02:56:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:02 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:02 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:03 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b5b6107-b801-46c7-acb2-5fe6d226399c" returned: 0 in 0.795s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-9b5b6107-b801-46c7-acb2-5fe6d226399c" released by "delete_volume" :: held 1.773s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=115,cinder:INSERT=37,cinder:UPDATE=157,cinder:DELETE=9 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=126,cinder:UPDATE=130,cinder:DELETE=11,cinder:INSERT=38 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Created reservations ['30e2aeac-6876-4332-88a8-eac635f5df2e', 'c678aaaa-f118-4b92-9315-6b29b4ef029d', '7b37f293-9144-4573-b38b-022cff834c29', '58c24c4a-9153-4fec-aed5-cd92611201c0'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:03 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:03 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:03 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.727s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:03 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info Jul 09 02:56:03 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-143f813c-2499-4b1c-a764-2883e3f8d4b3-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-143f813c-2499-4b1c-a764-2883e3f8d4b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-quobyte-143f813c-2499-4b1c-a764-2883e3f8d4b3" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-143f813c-2499-4b1c-a764-2883e3f8d4b3" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3ff64-2334-4a70-b66f-29395a2108bb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:03 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 Jul 09 02:56:03 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:03 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Deleted volume successfully. Jul 09 02:56:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2938a87-d20c-480d-baf9-e85031434baf tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-9b5b6107-b801-46c7-acb2-5fe6d226399c-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:04 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info" returned: 0 in 0.839s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:04 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info is being set with open permissions: ugo+rw Jul 09 02:56:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:04 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info Jul 09 02:56:04 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:04 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3" returned: 0 in 0.998s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:04 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3 Jul 09 02:56:04 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:05 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.info" returned: 0 in 0.788s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.317s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.584s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-443014072',display_name='tempest-VolumesGetTest-Volume-541699197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04ce4a8-5eba-499c-8e9e-f5de4daee55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:01Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Creating volume f04ce4a8-5eba-499c-8e9e-f5de4daee55e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:05 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:05 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e 1073741824 Jul 09 02:56:05 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5381be38-5194-4a43-8d57-39eb8c5bec05 tempest-VolumesSnapshotTestJSON-516389980 None] Create snapshot completed successfully Jul 09 02:56:05 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-143f813c-2499-4b1c-a764-2883e3f8d4b3" returned: 0 in 0.720s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-143f813c-2499-4b1c-a764-2883e3f8d4b3" released by "delete_volume" :: held 1.769s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Created reservations ['e05fb5b0-3055-4957-ba85-50f09ae41aa1', 'ec9f42f2-dbd9-413d-9470-3352c2ca9777', '4fc4be06-d437-4a55-9c30-4c3bcddda88c', 'fc747776-1c6c-424b-9e1b-b05ede1283e3'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:05 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:05 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-7b8fa3c2-ba3e-4980-809c-513336251478-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-7b8fa3c2-ba3e-4980-809c-513336251478-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "cinder-quobyte-7b8fa3c2-ba3e-4980-809c-513336251478" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-7b8fa3c2-ba3e-4980-809c-513336251478" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[565537a5-1748-4651-a9b7-291e8eb1648c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:06 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 Jul 09 02:56:06 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:06 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e 1073741824" returned: 0 in 1.242s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:06 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.943s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:06 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e Jul 09 02:56:06 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Deleted volume successfully. Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e4185b1-40d5-46fa-b5b2-c134dee98fc8 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-143f813c-2499-4b1c-a764-2883e3f8d4b3-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (9f81ff3f-e0b4-4f8f-9dc5-98697c2aa9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01afa4a9-1def-414a-8410-3f71c96533fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01afa4a9-1def-414a-8410-3f71c96533fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1132292744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41786fd8-97ad-4485-b21f-43cba2e47b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b08bd4d705244cca85ec06494f25161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=984821c0-0167-4f10-a318-c2e6c3049dcd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:07Z,use_quota=True,user_id='343458e452f24eeaa27ea715f5ddfb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb65c1c-5d36-4e8b-896a-2394471fc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb65c1c-5d36-4e8b-896a-2394471fc956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55898e19-2c70-4634-9b72-681af46037ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55898e19-2c70-4634-9b72-681af46037ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41786fd8-97ad-4485-b21f-43cba2e47b6f', 'volume_name': 'volume-41786fd8-97ad-4485-b21f-43cba2e47b6f', 'volume_size': 1, 'snapshot_id': '984821c0-0167-4f10-a318-c2e6c3049dcd'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070744f5-4eeb-48e0-bdd1-203496ab648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070744f5-4eeb-48e0-bdd1-203496ab648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e6ccd0-a094-4457-b1b5-76ae1d2b70b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:07 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Volume 41786fd8-97ad-4485-b21f-43cba2e47b6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41786fd8-97ad-4485-b21f-43cba2e47b6f', 'volume_size': 1, 'snapshot_id': '984821c0-0167-4f10-a318-c2e6c3049dcd'} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:07 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478" returned: 0 in 1.083s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:07 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478 Jul 09 02:56:07 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:07 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" returned: 0 in 0.945s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.448s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd-41786fd8-97ad-4485-b21f-43cba2e47b6f" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c29cea6-3134-4ab4-b720-fb07bdde676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e26f66d-44a0-4c8f-8ade-8031cfb4609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd-41786fd8-97ad-4485-b21f-43cba2e47b6f" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Creating volume 41786fd8-97ad-4485-b21f-43cba2e47b6f from snapshot 984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:07 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Volume volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e (f04ce4a8-5eba-499c-8e9e-f5de4daee55e): created successfully Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e26f66d-44a0-4c8f-8ade-8031cfb4609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (9691cb5b-4bda-4bf0-be1e-27d337afe1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] snapshot: 984821c0-0167-4f10-a318-c2e6c3049dcd, volume: 41786fd8-97ad-4485-b21f-43cba2e47b6f, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:56:07 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0e7825f-6cf3-4469-86da-f4386ee4c29a tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[83deed32-e22d-42a9-adc1-17a867bb14a6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:07 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:07 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:07 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7b8fa3c2-ba3e-4980-809c-513336251478" returned: 0 in 0.746s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-quobyte-7b8fa3c2-ba3e-4980-809c-513336251478" released by "delete_volume" :: held 1.890s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Created reservations ['7f9ca81c-aca8-48b7-b5d0-a03e258983a4', '9deae2a1-c655-4ce7-96b1-ea2b4391f4d7', 'bab9b988-230a-4b73-8cc9-a1ca75e89fc4', 'ff3ad42f-f6d3-4527-a156-f8fc32d59700'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-f04ce4a8-5eba-499c-8e9e-f5de4daee55e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "cinder-f04ce4a8-5eba-499c-8e9e-f5de4daee55e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" acquired by "delete_volume" :: waited 0.062s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:08 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:08 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4040d-bd1e-4e2c-8373-5784efa5dd52]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:08 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e Jul 09 02:56:08 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:08 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.946s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce118acd-042d-4110-89a5-e4ca0fa9d038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef0bfd-6370-46c7-8c50-a32452b2c714]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:08 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:08 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:09 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Deleted volume successfully. Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2c395c51-0254-426c-b5eb-99c0b0dd02b2 tempest-CreateVolumesFromImageTest-39645982 None] Lock "cinder-7b8fa3c2-ba3e-4980-809c-513336251478-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:09 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" returned: 0 in 1.029s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:09 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e Jul 09 02:56:09 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:09 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 1.146s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:56:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:09 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f Jul 09 02:56:09 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:10 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" returned: 0 in 0.948s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-f04ce4a8-5eba-499c-8e9e-f5de4daee55e" released by "delete_volume" :: held 2.054s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Created reservations ['b727e263-fac3-4f69-8c9f-7aed2c9b0f8a', 'd459d4c0-fb9a-4307-a818-c4e9f70498c6', '0017b237-b0ec-4226-a4b4-60f54e7ba95a', 'b7469b4d-ccb3-4eca-a3da-433c742834dc'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:10 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:10 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-865cd180-be75-49d0-9dc3-839cb56078cb-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "cinder-865cd180-be75-49d0-9dc3-839cb56078cb-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-865cd180-be75-49d0-9dc3-839cb56078cb" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-865cd180-be75-49d0-9dc3-839cb56078cb" acquired by "delete_volume" :: waited 0.043s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe44ce0-7178-435a-b105-f9cfe8e0c7df]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:12 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.839s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:56:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c8d0137e-a14d-41b9-8611-a82953b50c1f tempest-VolumesGetTest-185141038 None] Lock "cinder-f04ce4a8-5eba-499c-8e9e-f5de4daee55e-delete_volume" released by "delete_volume" :: held 4.332s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:12 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb Jul 09 02:56:12 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:13 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb" returned: 0 in 1.671s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:13 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb Jul 09 02:56:13 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:15 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-865cd180-be75-49d0-9dc3-839cb56078cb" returned: 0 in 1.616s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-865cd180-be75-49d0-9dc3-839cb56078cb" released by "delete_volume" :: held 3.398s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Created reservations ['73ae31cc-3304-4dbc-a9d8-ae88cf74d911', '7388a657-f3fb-4cc2-b1d5-e918adbbd8ef', 'fc105d61-14da-4169-a1b2-ee2d1f15b8d6', '9197a909-fd55-4376-bb3d-63d89adaec25'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (f25bb147-2ce5-4e3c-985e-419a948dd272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e3c36d-429c-46ed-9821-c5d6d9957f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e3c36d-429c-46ed-9821-c5d6d9957f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738930775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd974f8d-1479-45e1-b2c1-552927050e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:16Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dd640b-b63e-43d7-954e-3ff3429cb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dd640b-b63e-43d7-954e-3ff3429cb97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2f9149-265d-4ab1-b57d-0ecc1be1c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2f9149-265d-4ab1-b57d-0ecc1be1c08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd974f8d-1479-45e1-b2c1-552927050e5f', 'volume_name': 'volume-fd974f8d-1479-45e1-b2c1-552927050e5f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a568a-1698-40ff-9734-846898ff9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a568a-1698-40ff-9734-846898ff9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd672622-c75b-4923-bf8d-42c8752a4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume fd974f8d-1479-45e1-b2c1-552927050e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd974f8d-1479-45e1-b2c1-552927050e5f', 'volume_size': 1} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:16 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:16 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:16 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f" returned: 0 in 6.489s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74b0b8-f289-48f1-b879-9efade34ef26]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:16 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:16 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:16 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:56:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-84bb002b-2d29-45d3-bf08-c60da9dce012 tempest-VolumesGetTest-185141038 None] Lock "cinder-865cd180-be75-49d0-9dc3-839cb56078cb-delete_volume" released by "delete_volume" :: held 5.006s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (6c167cb2-5c49-4dd0-a956-1e5b4ef70bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f528741f-f02f-487e-8fce-55bb656e22d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:17 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 1.167s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:56:17 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Converted 1024.00 MB image at 157.75 MB/s Jul 09 02:56:17 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f is being set with open permissions: ugo+rw Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f528741f-f02f-487e-8fce-55bb656e22d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1877163147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c427548f-19df-418a-af19-2a47a5d920e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:17Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f611bc2-208d-4ed6-99f9-ba4283575c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f611bc2-208d-4ed6-99f9-ba4283575c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d73c67f-a048-413c-938f-626acb8e904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:17 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f Jul 09 02:56:17 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d73c67f-a048-413c-938f-626acb8e904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c427548f-19df-418a-af19-2a47a5d920e2', 'volume_name': 'volume-c427548f-19df-418a-af19-2a47a5d920e2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791f0e93-f160-43ca-9de9-6f54f2adda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791f0e93-f160-43ca-9de9-6f54f2adda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33992a46-afaa-46bc-8fe5-084e71cd5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Volume c427548f-19df-418a-af19-2a47a5d920e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c427548f-19df-418a-af19-2a47a5d920e2', 'volume_size': 1} Jul 09 02:56:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:18 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f" returned: 0 in 0.804s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" released by "_copy_volume_from_snapshot" :: held 10.697s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd-41786fd8-97ad-4485-b21f-43cba2e47b6f" released by "_create_volume_from_snapshot" :: held 10.755s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.806s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738930775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd974f8d-1479-45e1-b2c1-552927050e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:16Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:18 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:18 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f 1073741824 Jul 09 02:56:18 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e6ccd0-a094-4457-b1b5-76ae1d2b70b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41786fd8-97ad-4485-b21f-43cba2e47b6f', 'volume_size': 1, 'snapshot_id': '984821c0-0167-4f10-a318-c2e6c3049dcd'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e237e9-97eb-474d-96f4-5d013a966f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Volume volume-41786fd8-97ad-4485-b21f-43cba2e47b6f (41786fd8-97ad-4485-b21f-43cba2e47b6f): created successfully Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e237e9-97eb-474d-96f4-5d013a966f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Flow 'volume_create_manager' (9f81ff3f-e0b4-4f8f-9dc5-98697c2aa9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8be88ce4-9140-43aa-8f04-068117b1d2fb tempest-VolumesSnapshotTestJSON-516389980 None] Created volume successfully. Jul 09 02:56:19 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f 1073741824" returned: 0 in 0.969s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:19 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f Jul 09 02:56:19 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-41786fd8-97ad-4485-b21f-43cba2e47b6f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-41786fd8-97ad-4485-b21f-43cba2e47b6f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bee7495-43ae-43f9-ae0c-2acbe1ceddbb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:19 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f Jul 09 02:56:19 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:20 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f" returned: 0 in 0.784s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.586s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1877163147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c427548f-19df-418a-af19-2a47a5d920e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:17Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Creating volume c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:20 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:20 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 1073741824 Jul 09 02:56:20 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd672622-c75b-4923-bf8d-42c8752a4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd974f8d-1479-45e1-b2c1-552927050e5f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fa4646-f627-4c39-adcf-e1818020a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-fd974f8d-1479-45e1-b2c1-552927050e5f (fd974f8d-1479-45e1-b2c1-552927050e5f): created successfully Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fa4646-f627-4c39-adcf-e1818020a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (f25bb147-2ce5-4e3c-985e-419a948dd272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e4086a2a-9f83-40ff-9c5e-49b5914ac3b7 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Flow 'volume_create_manager' (4001e2bc-4889-4296-ba19-33cd7dd93353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7c6aec-9a4b-444e-a4f8-9c5d75f89216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7c6aec-9a4b-444e-a4f8-9c5d75f89216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-454910942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b905658c-b06c-40f3-be92-4fb689ce0660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d6824b3fd447f7bf7d536764f5c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:20Z,use_quota=True,user_id='d479655f5ddb4b62979d0bd4c019bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b747bc-23c0-4bb5-87f3-4242ac8dc336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b747bc-23c0-4bb5-87f3-4242ac8dc336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c777bde7-cf83-4c1f-9106-07671e4b9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c777bde7-cf83-4c1f-9106-07671e4b9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b905658c-b06c-40f3-be92-4fb689ce0660', 'volume_name': 'volume-b905658c-b06c-40f3-be92-4fb689ce0660', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a81244-31bf-4799-a890-29d869c5ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a81244-31bf-4799-a890-29d869c5ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec72001c-eae6-4d09-9a35-1ebfb3c8a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Volume b905658c-b06c-40f3-be92-4fb689ce0660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b905658c-b06c-40f3-be92-4fb689ce0660', 'volume_size': 1} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:20 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f" returned: 0 in 0.901s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:20 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f Jul 09 02:56:20 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:21 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 1073741824" returned: 0 in 0.929s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:21 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:56:21 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:21 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-41786fd8-97ad-4485-b21f-43cba2e47b6f" returned: 0 in 0.712s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-41786fd8-97ad-4485-b21f-43cba2e47b6f" released by "delete_volume" :: held 1.662s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['bd4c693c-212b-4407-9f1e-c3603e26c655', '0da4e220-2a31-4a4d-9efb-6fa598d643ee', '1e344ea7-9051-4854-9f72-846ff8086212', '3083db1d-d917-436a-a133-f56c5f42e288'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:21 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:21 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:21 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-454910942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b905658c-b06c-40f3-be92-4fb689ce0660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d6824b3fd447f7bf7d536764f5c45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:20Z,use_quota=True,user_id='d479655f5ddb4b62979d0bd4c019bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Creating volume b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:21 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-984821c0-0167-4f10-a318-c2e6c3049dcd-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:21 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 1073741824 Jul 09 02:56:21 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33992a46-afaa-46bc-8fe5-084e71cd5608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c427548f-19df-418a-af19-2a47a5d920e2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d10c14-7f2e-4dbf-9526-faf9940edde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:21 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Volume volume-c427548f-19df-418a-af19-2a47a5d920e2 (c427548f-19df-418a-af19-2a47a5d920e2): created successfully Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d10c14-7f2e-4dbf-9526-faf9940edde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (6c167cb2-5c49-4dd0-a956-1e5b4ef70bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-984821c0-0167-4f10-a318-c2e6c3049dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-80d20e03-3c7d-422b-a745-16b720b23c40 tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Deleting offline snapshot 984821c0-0167-4f10-a318-c2e6c3049dcd of volume ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] snapshot_file for this snap is: volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8043873-9811-4fcf-a851-7aca2378c9ff]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:22 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:22 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:22 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.782s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Deleted volume successfully. Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1f59a11-5f67-4594-b367-c822942671a5 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-41786fd8-97ad-4485-b21f-43cba2e47b6f-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:22 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 1073741824" returned: 0 in 0.914s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:22 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 Jul 09 02:56:22 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:22 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.913s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce118acd-042d-4110-89a5-e4ca0fa9d038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[025253c1-63cf-4a90-a22a-c76556118cc9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:23 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:23 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (c0592e92-ae42-4471-ac3b-453f4696d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6ecc5-4d2e-4c61-9549-e304b840e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6ecc5-4d2e-4c61-9549-e304b840e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-637464308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41b2925-3687-4114-bf81-6dd01f3becf1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c427548f-19df-418a-af19-2a47a5d920e2,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:23Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917b672c-a2ce-4078-958c-8dafa2df6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917b672c-a2ce-4078-958c-8dafa2df6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaa8629-b391-485e-8acf-d3acd7bd610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaa8629-b391-485e-8acf-d3acd7bd610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd41b2925-3687-4114-bf81-6dd01f3becf1', 'volume_name': 'volume-d41b2925-3687-4114-bf81-6dd01f3becf1', 'volume_size': 1, 'source_volid': 'c427548f-19df-418a-af19-2a47a5d920e2', 'source_volstatus': 'available'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4e5af9-6c25-4e66-b211-a3518d0b5af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4e5af9-6c25-4e66-b211-a3518d0b5af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f864f31-1890-41fb-801a-26ff3be7bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Volume d41b2925-3687-4114-bf81-6dd01f3becf1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d41b2925-3687-4114-bf81-6dd01f3becf1', 'volume_size': 1, 'source_volid': 'c427548f-19df-418a-af19-2a47a5d920e2', 'source_volstatus': 'available'} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:23 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660" returned: 0 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.486s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating offline snapshot 0d9b2a4c-f08d-4993-91b6-2bb78348bbca of volume fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec72001c-eae6-4d09-9a35-1ebfb3c8a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b905658c-b06c-40f3-be92-4fb689ce0660', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc52779-742e-4d0e-8ac2-3501aba98ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ca88c-2300-484c-90f2-bc06e6540f4e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:23 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Volume volume-b905658c-b06c-40f3-be92-4fb689ce0660 (b905658c-b06c-40f3-be92-4fb689ce0660): created successfully Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc52779-742e-4d0e-8ac2-3501aba98ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Flow 'volume_create_manager' (4001e2bc-4889-4296-ba19-33cd7dd93353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-af059ec4-5803-4771-90f8-a86dbd3df43a tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Created volume successfully. Jul 09 02:56:23 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f Jul 09 02:56:23 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:23 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:23 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:23 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:24 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f" returned: 0 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:24 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca 1G Jul 09 02:56:24 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:24 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:24 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd Jul 09 02:56:24 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:25 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca 1G" returned: 0 in 0.884s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd974f8d-1479-45e1-b2c1-552927050e5f -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:25 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd974f8d-1479-45e1-b2c1-552927050e5f -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca Jul 09 02:56:25 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:25 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038.984821c0-0167-4f10-a318-c2e6c3049dcd" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-984821c0-0167-4f10-a318-c2e6c3049dcd" released by "_delete_snapshot" :: held 3.391s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" released by "delete_snapshot" :: held 3.418s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['e644d3ac-8c25-4d5d-8cfb-1fbde050fd3a', '6812de77-96a2-44bf-bc71-2423ac6fbc5d', '7e66fd12-ce6d-4c04-8182-ae7bf48cb7f1', 'cf179776-a1d4-49f5-aaf8-e9ac4ecc625e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Delete snapshot completed successfully. Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3ae13955-d392-485a-81db-f6c9afa3d6c1 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-984821c0-0167-4f10-a318-c2e6c3049dcd-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:25 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd974f8d-1479-45e1-b2c1-552927050e5f -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca" returned: 0 in 0.677s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:25 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca is being set with open permissions: ugo+rw Jul 09 02:56:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:25 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca Jul 09 02:56:25 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-ce118acd-042d-4110-89a5-e4ca0fa9d038-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-ce118acd-042d-4110-89a5-e4ca0fa9d038-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c765e2-744e-4638-ba62-8477412c9a4a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:26 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:26 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:26 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca" returned: 0 in 0.650s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:26 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info Jul 09 02:56:26 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:27 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:27 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038 Jul 09 02:56:27 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:27 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info" returned: 0 in 0.680s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:27 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info is being set with open permissions: ugo+rw Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:27 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info Jul 09 02:56:27 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:27 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce118acd-042d-4110-89a5-e4ca0fa9d038" returned: 0 in 0.650s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-ce118acd-042d-4110-89a5-e4ca0fa9d038" released by "delete_volume" :: held 1.468s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['7e7ad909-b371-42b7-9c4e-5b86a2d5efd9', '1377cc34-ed08-4398-bfa1-bd62e08ee5a7', '3626387c-7061-47a7-8c32-b69801ebde7f', '738d9590-ed91-405d-be19-9ba050ec9665'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:27 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:27 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:27 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.info" returned: 0 in 0.652s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.512s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:27 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Cloning volume c427548f-19df-418a-af19-2a47a5d920e2 to volume d41b2925-3687-4114-bf81-6dd01f3becf1 Jul 09 02:56:27 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:27 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-61801fb0-849d-4cc2-9791-010022708105 tempest-CreateVolumesFromSnapshotTest-485363088 None] Create snapshot completed successfully Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Creating offline snapshot fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee of volume c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa38c4a0-d415-4a31-b5a1-5b9f39ed0521]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:28 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:56:28 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:28 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.782s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Deleted volume successfully. Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-cf789b6a-2083-437b-abf2-6f7244762101-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ae06206d-dc0d-4c50-8a6e-f1dbc5eea819 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-ce118acd-042d-4110-89a5-e4ca0fa9d038-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-cf789b6a-2083-437b-abf2-6f7244762101-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:28 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.752s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c822d-bceb-4831-900c-ac162d7f0dbc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:28 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 Jul 09 02:56:28 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:29 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 0.989s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:29 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee 1G Jul 09 02:56:29 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (9a708a46-5eb9-451b-a075-ec3f5e8f1945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b325c0-d8e4-49d0-a6c6-4240c391c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b325c0-d8e4-49d0-a6c6-4240c391c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571610796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d951f0-c537-4ae5-9a34-21748218f31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:29Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd6106-cc19-448f-aeb0-acf3d4fa8668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd6106-cc19-448f-aeb0-acf3d4fa8668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb49765-369b-4aae-bdac-65abfcbb18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb49765-369b-4aae-bdac-65abfcbb18f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d951f0-c537-4ae5-9a34-21748218f31b', 'volume_name': 'volume-52d951f0-c537-4ae5-9a34-21748218f31b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6415fb-43e1-47b0-bced-1f4659bacbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6415fb-43e1-47b0-bced-1f4659bacbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287f761-a537-4a38-8cf0-d6d0448a4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume 52d951f0-c537-4ae5-9a34-21748218f31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d951f0-c537-4ae5-9a34-21748218f31b', 'volume_size': 1} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (d82b08ee-d298-4c22-9918-d0ccdf500676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15860838-aafb-4d4d-9e6b-3c9cda07615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15860838-aafb-4d4d-9e6b-3c9cda07615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6054246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fd74fa-ee8c-4939-881a-de4eb2f7f333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa94db96-8ae9-47e3-b335-a12c73a0f235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa94db96-8ae9-47e3-b335-a12c73a0f235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897c88a2-50a3-4331-ba86-95cca1b32adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897c88a2-50a3-4331-ba86-95cca1b32adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fd74fa-ee8c-4939-881a-de4eb2f7f333', 'volume_name': 'volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e625e0-0249-4305-83ac-2b6c80f35202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e625e0-0249-4305-83ac-2b6c80f35202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77fe4bd-e2bb-4714-813a-f1682ba9bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume f2fd74fa-ee8c-4939-881a-de4eb2f7f333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333', 'volume_size': 1} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:29 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101" returned: 0 in 1.081s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:29 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101 Jul 09 02:56:29 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (eec2b610-2d45-49d3-9cfe-55d55da4739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd31c944-fd01-4488-ae90-8b113deafe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd31c944-fd01-4488-ae90-8b113deafe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1003842224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428705a-2605-4d2f-89e2-b9e9d88133be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c67a2a-1aac-40e6-b26f-cfa4663efda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c67a2a-1aac-40e6-b26f-cfa4663efda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc6f35f-5d60-42c9-84c6-174f407f78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc6f35f-5d60-42c9-84c6-174f407f78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b428705a-2605-4d2f-89e2-b9e9d88133be', 'volume_name': 'volume-b428705a-2605-4d2f-89e2-b9e9d88133be', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff139dd-d59d-4660-a3f9-5df61f4b0f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff139dd-d59d-4660-a3f9-5df61f4b0f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a9cdf5-66d3-4fd1-becb-ec7ac39c0bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume b428705a-2605-4d2f-89e2-b9e9d88133be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b428705a-2605-4d2f-89e2-b9e9d88133be', 'volume_size': 1} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:30 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee 1G" returned: 0 in 1.159s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c427548f-19df-418a-af19-2a47a5d920e2 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:30 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c427548f-19df-418a-af19-2a47a5d920e2 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:30 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (ce11e40f-7079-4911-8a60-1e0e339ba197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167ac32-88e4-498a-8fbb-31128cda506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167ac32-88e4-498a-8fbb-31128cda506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510630086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a31d6d7-8591-4208-91d4-6551d6824cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14285c-c042-4508-9f59-e56c36560a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14285c-c042-4508-9f59-e56c36560a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3355c186-c9fb-41bf-80a2-3756627fe85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3355c186-c9fb-41bf-80a2-3756627fe85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a31d6d7-8591-4208-91d4-6551d6824cc9', 'volume_name': 'volume-6a31d6d7-8591-4208-91d4-6551d6824cc9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb962be-164c-4d22-a1ee-16b118fc4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb962be-164c-4d22-a1ee-16b118fc4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7178b6e-6675-4cdb-bd07-4747afcedcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume 6a31d6d7-8591-4208-91d4-6551d6824cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a31d6d7-8591-4208-91d4-6551d6824cc9', 'volume_size': 1} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:30 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cf789b6a-2083-437b-abf2-6f7244762101" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-quobyte-cf789b6a-2083-437b-abf2-6f7244762101" released by "delete_volume" :: held 2.004s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Created reservations ['394cbd0c-f5f2-4de9-a1d2-be1f47cb29f6', 'e1ad665d-616d-45f7-84c2-130ecae40e34', '391433e3-2445-4fb1-a4b0-badb9e62655b', '9b46636e-ccc7-4b29-97c1-3dacbc516b37'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:30 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:30 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (bbd933e5-e9fd-45ea-b441-187d52907438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762c55c-67cf-4e8b-91e4-b57159a48d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762c55c-67cf-4e8b-91e4-b57159a48d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062589857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cdd382-97eb-467c-9a09-9a7dda1c5125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:31Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce05940-dcf4-4dc7-8ed9-dcec0551b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce05940-dcf4-4dc7-8ed9-dcec0551b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5156b615-9be4-4ae7-ab87-70a5118f9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:31 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5156b615-9be4-4ae7-ab87-70a5118f9edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cdd382-97eb-467c-9a09-9a7dda1c5125', 'volume_name': 'volume-77cdd382-97eb-467c-9a09-9a7dda1c5125', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aebba45-9265-4da8-9282-1a52db9ab418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aebba45-9265-4da8-9282-1a52db9ab418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2296f0c-c5f8-45db-bd3f-f6640da88ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume 77cdd382-97eb-467c-9a09-9a7dda1c5125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cdd382-97eb-467c-9a09-9a7dda1c5125', 'volume_size': 1} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c427548f-19df-418a-af19-2a47a5d920e2 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.908s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:31 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee is being set with open permissions: ugo+rw Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:31 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:31 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:31 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:56:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Deleted volume successfully. Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7e465478-436d-4d31-b325-8c99f1858de8 tempest-VolumesSnapshotTestJSON-516389980 None] Lock "cinder-cf789b6a-2083-437b-abf2-6f7244762101-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:31 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.665s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:31 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info Jul 09 02:56:31 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:32 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:32 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info is being set with open permissions: ugo+rw Jul 09 02:56:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:32 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info Jul 09 02:56:32 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:33 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.info" returned: 0 in 0.682s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] snapshot: fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee, volume: d41b2925-3687-4114-bf81-6dd01f3becf1, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff228f8a-85cd-4f33-b71b-83eb391a0902]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:33 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:33 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:34 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.886s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c427548f-19df-418a-af19-2a47a5d920e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04449cb-b405-4b96-b075-e0129a0909d9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:34 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:56:34 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:34 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:56:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:34 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 Jul 09 02:56:34 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:40 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1" returned: 0 in 5.289s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8a498-a18f-4eff-8939-d2af190888fc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:40 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:56:40 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:41 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 1.031s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:56:41 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Converted 1024.00 MB image at 193.57 MB/s Jul 09 02:56:41 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 is being set with open permissions: ugo+rw Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:41 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 Jul 09 02:56:41 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=81,cinder:INSERT=21,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:INSERT=23,cinder:UPDATE=100,cinder:SELECT=56,cinder:DELETE=9 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:56:41 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1" returned: 0 in 0.740s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" released by "_copy_volume_from_snapshot" :: held 8.843s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Deleting offline snapshot fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee of volume c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] snapshot_file for this snap is: volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df6c5a7-0017-4e19-b45e-469c360138c6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:42 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:42 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:42 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.755s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c427548f-19df-418a-af19-2a47a5d920e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc1e1f-3039-4dde-9e34-56c0ae2b2b54]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:42 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:56:42 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:43 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 0.853s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:43 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:43 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:44 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:44 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee Jul 09 02:56:44 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:45 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2.fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" returned: 0 in 0.698s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-fcc83a6c-df4f-433b-a1d9-b4d87ca4fdee" released by "_delete_snapshot" :: held 3.269s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.402s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.529s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Creating offline snapshot a4efa750-c919-44d6-96be-70524941052c of volume b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f864f31-1890-41fb-801a-26ff3be7bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41b2925-3687-4114-bf81-6dd01f3becf1', 'volume_size': 1, 'source_volid': 'c427548f-19df-418a-af19-2a47a5d920e2', 'source_volstatus': 'available'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ce10c-2bf0-4dda-b862-a2f85476f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf437de4-e00f-4bc7-b11f-27a6f7fee345]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Volume volume-d41b2925-3687-4114-bf81-6dd01f3becf1 (d41b2925-3687-4114-bf81-6dd01f3becf1): created successfully Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ce10c-2bf0-4dda-b862-a2f85476f50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (c0592e92-ae42-4471-ac3b-453f4696d26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4274d547-5aef-4492-889d-c62757faa502 tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:56:45 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 Jul 09 02:56:45 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:46 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660" returned: 0 in 0.881s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:46 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c 1G Jul 09 02:56:46 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (58f6f521-ced6-4a8b-846d-e3dc5dd6c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b862e10b-afb8-46e8-a54c-929fc7bf18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b862e10b-afb8-46e8-a54c-929fc7bf18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1922794678',display_name='tempest-VolumesGetTest-Volume-129047258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:47Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686ab5e-cd27-43d8-b637-80d1f3cb126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686ab5e-cd27-43d8-b637-80d1f3cb126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fa0b5e-b9ff-4aaf-9a33-540da77264e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fa0b5e-b9ff-4aaf-9a33-540da77264e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ba1b93-7c99-4e99-a1c2-a4ba6ff54273', 'volume_name': 'volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1221c575-37ff-495c-8244-b90c65d5df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1221c575-37ff-495c-8244-b90c65d5df70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b088c577-b16f-4881-949c-a7552fef409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:47 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Volume d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273', 'volume_size': 1} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:47 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c 1G" returned: 0 in 1.010s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b905658c-b06c-40f3-be92-4fb689ce0660 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:47 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b905658c-b06c-40f3-be92-4fb689ce0660 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c Jul 09 02:56:47 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:48 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b905658c-b06c-40f3-be92-4fb689ce0660 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:48 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c is being set with open permissions: ugo+rw Jul 09 02:56:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:48 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c Jul 09 02:56:48 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:48 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c" returned: 0 in 0.642s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:48 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info Jul 09 02:56:48 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:49 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:49 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info is being set with open permissions: ugo+rw Jul 09 02:56:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:49 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info Jul 09 02:56:49 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:50 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.info" returned: 0 in 0.653s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.705s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.839s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571610796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d951f0-c537-4ae5-9a34-21748218f31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:29Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume 52d951f0-c537-4ae5-9a34-21748218f31b {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:50 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b 1073741824 Jul 09 02:56:50 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-333d5a2f-48eb-425d-b9d1-c5bcbcaaa9ee tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Create snapshot completed successfully Jul 09 02:56:50 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b 1073741824" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:50 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b Jul 09 02:56:50 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "cinder-a4efa750-c919-44d6-96be-70524941052c-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-a4efa750-c919-44d6-96be-70524941052c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "cinder-quobyte-a4efa750-c919-44d6-96be-70524941052c" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-a4efa750-c919-44d6-96be-70524941052c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Deleting offline snapshot a4efa750-c919-44d6-96be-70524941052c of volume b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] snapshot_file for this snap is: volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b62ee-bd01-4ff8-8927-7dfe1780d8d7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:51 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.997s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-6054246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fd74fa-ee8c-4939-881a-de4eb2f7f333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume f2fd74fa-ee8c-4939-881a-de4eb2f7f333 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:51 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:51 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 1073741824 Jul 09 02:56:51 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287f761-a537-4a38-8cf0-d6d0448a4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d951f0-c537-4ae5-9a34-21748218f31b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae62f5-1fd1-4250-8a45-e94870068bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-52d951f0-c537-4ae5-9a34-21748218f31b (52d951f0-c537-4ae5-9a34-21748218f31b): created successfully Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae62f5-1fd1-4250-8a45-e94870068bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (9a708a46-5eb9-451b-a075-ec3f5e8f1945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:51 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c Jul 09 02:56:51 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e8333221-a827-4952-8ae6-52a8004049db tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:52 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c" returned: 0 in 1.070s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b905658c-b06c-40f3-be92-4fb689ce0660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f7233a-ae98-402e-ba2a-9427d74461e4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:52 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 1073741824" returned: 0 in 1.090s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:52 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 Jul 09 02:56:52 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:52 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 Jul 09 02:56:52 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:53 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" returned: 0 in 0.786s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.459s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1003842224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428705a-2605-4d2f-89e2-b9e9d88133be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume b428705a-2605-4d2f-89e2-b9e9d88133be {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:53 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77fe4bd-e2bb-4714-813a-f1682ba9bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddad534c-c0c0-4a5c-8b2c-8d775252ea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:53 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be 1073741824 Jul 09 02:56:53 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 (f2fd74fa-ee8c-4939-881a-de4eb2f7f333): created successfully Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddad534c-c0c0-4a5c-8b2c-8d775252ea0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (d82b08ee-d298-4c22-9918-d0ccdf500676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-59b787ee-d91d-4c55-a387-83884063118c tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:54 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660" returned: 0 in 1.234s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:54 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c Jul 09 02:56:54 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:54 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be 1073741824" returned: 0 in 1.233s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:54 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be Jul 09 02:56:54 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:55 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c" returned: 0 in 1.046s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:55 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c Jul 09 02:56:55 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:55 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be" returned: 0 in 0.848s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.130s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510630086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a31d6d7-8591-4208-91d4-6551d6824cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:30Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume 6a31d6d7-8591-4208-91d4-6551d6824cc9 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:55 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:55 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a9cdf5-66d3-4fd1-becb-ec7ac39c0bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b428705a-2605-4d2f-89e2-b9e9d88133be', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:55 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 1073741824 Jul 09 02:56:55 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770d2cf2-40cc-498d-a808-6679a4cf93df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660.a4efa750-c919-44d6-96be-70524941052c" returned: 0 in 0.795s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-b428705a-2605-4d2f-89e2-b9e9d88133be (b428705a-2605-4d2f-89e2-b9e9d88133be): created successfully Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770d2cf2-40cc-498d-a808-6679a4cf93df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (eec2b610-2d45-49d3-9cfe-55d55da4739c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-a4efa750-c919-44d6-96be-70524941052c" released by "_delete_snapshot" :: held 4.301s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" released by "delete_snapshot" :: held 4.333s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34f2d44f-c524-4826-b77c-877d5ad1be39 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:56 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Created reservations ['a2b21379-afc9-4cad-a3be-52399f54645b', '1cd2afe8-4357-4747-a770-a0c72e6a535d', '1754d916-cbdd-4248-80a0-5345698ac803', '4e4910ec-ff8c-4aab-a589-70a34477ea17'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Delete snapshot completed successfully. Jul 09 02:56:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-920326df-f9ab-4236-ac97-2de248fe15c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-a4efa750-c919-44d6-96be-70524941052c-delete_snapshot" released by "delete_snapshot" :: held 4.532s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:56 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 1073741824" returned: 0 in 0.918s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:56 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 Jul 09 02:56:56 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "cinder-b905658c-b06c-40f3-be92-4fb689ce0660-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-b905658c-b06c-40f3-be92-4fb689ce0660-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e148be7-77d4-4951-8fbe-64b8f18ce47f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:57 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 Jul 09 02:56:57 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:57 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.441s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062589857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cdd382-97eb-467c-9a09-9a7dda1c5125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a96e595537492c98af052a9ca35622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:31Z,use_quota=True,user_id='12e12d3206cc4608aa495fdccfb136ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Creating volume 77cdd382-97eb-467c-9a09-9a7dda1c5125 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:57 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:57 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 1073741824 Jul 09 02:56:57 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7178b6e-6675-4cdb-bd07-4747afcedcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a31d6d7-8591-4208-91d4-6551d6824cc9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af82bae-856d-4a5f-b7b6-145dd5a97a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:57 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 (6a31d6d7-8591-4208-91d4-6551d6824cc9): created successfully Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af82bae-856d-4a5f-b7b6-145dd5a97a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (ce11e40f-7079-4911-8a60-1e0e339ba197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5a50ce30-a475-486d-a7e8-5f75577dfef6 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:58 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660" returned: 0 in 0.859s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:58 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660 Jul 09 02:56:58 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:58 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 1073741824" returned: 0 in 0.952s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:58 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 Jul 09 02:56:58 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:58 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b905658c-b06c-40f3-be92-4fb689ce0660" returned: 0 in 0.702s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-quobyte-b905658c-b06c-40f3-be92-4fb689ce0660" released by "delete_volume" :: held 1.665s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Created reservations ['d07026c6-eef3-460f-be51-3ea2478663d6', 'd285dd73-7502-4e7a-8ac1-96248cebda19', '5f469aa8-3887-4b73-afa7-1de7b02e8c21', 'd09f55d1-f955-4b21-9fe3-e337f1bab7ce'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:59 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:56:59 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:59 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125" returned: 0 in 0.715s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.207s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:56:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1922794678',display_name='tempest-VolumesGetTest-Volume-129047258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:56:47Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Creating volume d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:56:59 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2296f0c-c5f8-45db-bd3f-f6640da88ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cdd382-97eb-467c-9a09-9a7dda1c5125', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:59 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 1073741824 Jul 09 02:56:59 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8213c6-2b0d-4d46-b66f-1c76804ad69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:56:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Volume volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 (77cdd382-97eb-467c-9a09-9a7dda1c5125): created successfully Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8213c6-2b0d-4d46-b66f-1c76804ad69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Flow 'volume_create_manager' (bbd933e5-e9fd-45ea-b441-187d52907438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:56:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0674d8f6-ebd0-4a81-806e-3554ccdb9d25 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created volume successfully. Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-77cdd382-97eb-467c-9a09-9a7dda1c5125-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-77cdd382-97eb-467c-9a09-9a7dda1c5125-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-77cdd382-97eb-467c-9a09-9a7dda1c5125" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-77cdd382-97eb-467c-9a09-9a7dda1c5125" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03407bc-d860-47f2-b982-c85d013458b6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:56:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:56:59 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 Jul 09 02:56:59 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:00 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.063s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:00 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Deleted volume successfully. Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b461a379-842a-41e3-b266-27f3817acd80 tempest-VolumeSnapshotQuotasNegativeTestJSON-981969945 None] Lock "cinder-b905658c-b06c-40f3-be92-4fb689ce0660-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:00 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 1073741824" returned: 0 in 1.378s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:00 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 Jul 09 02:57:00 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:00 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125" returned: 0 in 1.057s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:00 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125 Jul 09 02:57:00 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:01 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" returned: 0 in 0.947s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b088c577-b16f-4881-949c-a7552fef409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d996770-ea45-458b-a0d6-8583bb612d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Volume volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 (d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273): created successfully Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d996770-ea45-458b-a0d6-8583bb612d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (58f6f521-ced6-4a8b-846d-e3dc5dd6c3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:01 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-95306b34-0de0-43f3-85f3-b14b12b4afb0 tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-77cdd382-97eb-467c-9a09-9a7dda1c5125" returned: 0 in 0.909s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-77cdd382-97eb-467c-9a09-9a7dda1c5125" released by "delete_volume" :: held 2.053s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:01 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['ecce9e4d-fb58-4517-8823-432d911c7cef', '715d372c-5530-4f5e-a588-6a1cf5cf3a2e', '5f929505-62ac-4cfc-b422-9d8ef8c570d4', 'd7bf3bbd-d624-43f2-8010-c2f4983f2c18'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:02 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:02 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "cinder-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" acquired by "delete_volume" :: waited 0.036s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[987aac5f-e2a7-4475-a9c5-d008fa512c67]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:02 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 Jul 09 02:57:02 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:03 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.965s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0a5b60b5-d1c9-440a-8798-1320cef31f6a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-77cdd382-97eb-467c-9a09-9a7dda1c5125-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-6a31d6d7-8591-4208-91d4-6551d6824cc9-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-6a31d6d7-8591-4208-91d4-6551d6824cc9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-6a31d6d7-8591-4208-91d4-6551d6824cc9" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-6a31d6d7-8591-4208-91d4-6551d6824cc9" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3872a72d-8c7a-4586-8ad3-1c01fbdc4e87]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:03 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 Jul 09 02:57:03 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:03 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" returned: 0 in 1.212s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:03 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273 Jul 09 02:57:03 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:04 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9" returned: 0 in 0.968s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:04 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9 Jul 09 02:57:04 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:04 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" returned: 0 in 0.781s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273" released by "delete_volume" :: held 2.056s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Created reservations ['f8eb91cf-8639-4649-aeb6-19611dc37252', '7630069c-8adb-4ecb-9fd5-91ab942e3add', '44783721-ff6f-4ee2-af8e-b8a42df6f826', '303ded40-3dc8-44ea-8668-24acbe188add'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:04 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:04 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:05 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6a31d6d7-8591-4208-91d4-6551d6824cc9" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-6a31d6d7-8591-4208-91d4-6551d6824cc9" released by "delete_volume" :: held 1.896s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['93e583bb-a78d-4525-8eca-08095bb79dab', '66331301-3d24-4c4f-939e-4df1efb20890', '77060e1e-e115-457f-b94f-46e4aa606b58', '8962d692-7709-4f3a-a2f8-a9bf961a256d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:05 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:05 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:05 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-b428705a-2605-4d2f-89e2-b9e9d88133be-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.683s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-b428705a-2605-4d2f-89e2-b9e9d88133be-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cd82995a-9440-41c1-aef8-546f03c5008b tempest-VolumesGetTest-185141038 None] Lock "cinder-d2ba1b93-7c99-4e99-a1c2-a4ba6ff54273-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-b428705a-2605-4d2f-89e2-b9e9d88133be" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-b428705a-2605-4d2f-89e2-b9e9d88133be" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5119b2-348d-40cf-801f-b4585ec17830]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:05 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be Jul 09 02:57:05 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-d41b2925-3687-4114-bf81-6dd01f3becf1-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "cinder-d41b2925-3687-4114-bf81-6dd01f3becf1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa49d6a-a8ab-479f-b8a2-6c1d0fff8419]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:06 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.920s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:06 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 Jul 09 02:57:06 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69987db7-8bd7-4c7e-bf64-057dc69173bb tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-6a31d6d7-8591-4208-91d4-6551d6824cc9-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:06 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be" returned: 0 in 0.979s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:06 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be Jul 09 02:57:06 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:06 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1" returned: 0 in 0.906s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:07 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1 Jul 09 02:57:07 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:07 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b428705a-2605-4d2f-89e2-b9e9d88133be" returned: 0 in 0.907s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-b428705a-2605-4d2f-89e2-b9e9d88133be" released by "delete_volume" :: held 1.954s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['e9523523-f6b5-42ed-9068-3cd1b423c879', '4d8f344e-4a3e-4a55-9472-e1efae9f965a', '277cfdd3-6ecc-44f8-9558-1a766f7c5df2', 'cf2cb603-2c0f-497a-840f-a5cf075643c0'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:07 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d41b2925-3687-4114-bf81-6dd01f3becf1" returned: 0 in 0.768s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-d41b2925-3687-4114-bf81-6dd01f3becf1" released by "delete_volume" :: held 1.728s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:07 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:07 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Created reservations ['97d1ff5d-395a-4b29-ad54-de7c5e2294ac', 'cc3ba9ba-f26e-496b-bca6-543ee33634ab', '7d00a860-f423-42bd-a315-e99e0f0b63ba', '9d9b3ea3-3d80-4c2b-aa39-991cefadfe47'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:08 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:08 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-c427548f-19df-418a-af19-2a47a5d920e2-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "cinder-c427548f-19df-418a-af19-2a47a5d920e2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-c427548f-19df-418a-af19-2a47a5d920e2" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-c427548f-19df-418a-af19-2a47a5d920e2" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6fa63a-fc2a-44cd-a2d3-1470d69ad501]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:08 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.927s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:08 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:57:08 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a8f8a21a-2795-4432-ac5c-294c9706a52a tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-b428705a-2605-4d2f-89e2-b9e9d88133be-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-f2fd74fa-ee8c-4939-881a-de4eb2f7f333-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-f2fd74fa-ee8c-4939-881a-de4eb2f7f333-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[63366e52-bf23-4f3b-90d8-15b0280bf137]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:09 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.122s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a47de003-5a21-467e-8983-75bdd1471b25 tempest-VolumesGetTest-185141038 None] Lock "cinder-d41b2925-3687-4114-bf81-6dd01f3becf1-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:09 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 Jul 09 02:57:09 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:09 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 1.081s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:09 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2 Jul 09 02:57:09 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:10 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" returned: 0 in 1.176s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:10 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333 Jul 09 02:57:10 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:10 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c427548f-19df-418a-af19-2a47a5d920e2" returned: 0 in 0.998s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-c427548f-19df-418a-af19-2a47a5d920e2" released by "delete_volume" :: held 2.168s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Created reservations ['f5bd737d-1be8-413d-ab0d-0e96597fe55e', 'b5e46a92-8f48-497b-b87f-13a00a54d248', '1027a2cc-4c71-4300-b643-34cce4425c12', '059ca3a8-28ad-4fa5-97f5-afcf27b8f685'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:10 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:10 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:11 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" returned: 0 in 0.994s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-f2fd74fa-ee8c-4939-881a-de4eb2f7f333" released by "delete_volume" :: held 2.224s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['d9dbf1b4-436d-4231-943a-0b8ab7a30e28', '36ee44f4-1cf2-4e65-87a5-badd7c16a465', '8e36aed5-4bef-4b22-a35c-50975313416f', 'e4b4ea68-1e35-4a87-b357-8f1ad5a0fd3e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:11 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:11 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:11 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.913s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:57:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73b0f670-854b-4d38-bc4a-3ab56205f298 tempest-VolumesGetTest-185141038 None] Lock "cinder-c427548f-19df-418a-af19-2a47a5d920e2-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:12 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-52d951f0-c537-4ae5-9a34-21748218f31b-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.984s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-52d951f0-c537-4ae5-9a34-21748218f31b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-69a3ece1-6727-4bb6-9e37-af44d4d21672 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-f2fd74fa-ee8c-4939-881a-de4eb2f7f333-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-52d951f0-c537-4ae5-9a34-21748218f31b" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-52d951f0-c537-4ae5-9a34-21748218f31b" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed6264a-182c-458a-bfa6-ecf18f2d2325]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:12 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b Jul 09 02:57:12 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:12 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (6d622d46-7829-443c-af6c-c7b467bbf9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44acb1e-00d6-44a0-9038-5c7ae3d07873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44acb1e-00d6-44a0-9038-5c7ae3d07873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1983293721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ee63b-7618-45da-8815-7e66b43a0458,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:13Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcacea61-aa7d-44a7-8e99-9bd23725d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcacea61-aa7d-44a7-8e99-9bd23725d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fa51a6-3998-4aa4-886a-821fe6bedfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fa51a6-3998-4aa4-886a-821fe6bedfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a8ee63b-7618-45da-8815-7e66b43a0458', 'volume_name': 'volume-2a8ee63b-7618-45da-8815-7e66b43a0458', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e265a25-a4a6-429d-b20d-1cd888f7dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e265a25-a4a6-429d-b20d-1cd888f7dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ec0421-0d3b-44a4-b91d-c33c841d0f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:13 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Volume 2a8ee63b-7618-45da-8815-7e66b43a0458: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a8ee63b-7618-45da-8815-7e66b43a0458', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Trying to clone 2a8ee63b-7618-45da-8815-7e66b43a0458 from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 02:57:13 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b" returned: 0 in 1.088s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:13 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b Jul 09 02:57:13 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:13 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 02:57:13 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Image download 20.69 MB at 20.69 MB/s Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb33ba-235a-4f74-8d66-aecdefadea21]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:14 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD Jul 09 02:57:14 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:14 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-52d951f0-c537-4ae5-9a34-21748218f31b" returned: 0 in 0.914s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-52d951f0-c537-4ae5-9a34-21748218f31b" released by "delete_volume" :: held 2.062s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['96213ce5-e230-436f-ab6c-325a4a58ecff', 'c24de6b8-2008-4c51-b5b9-13b969c13e04', '5e7aca8c-c1f5-42a2-ac58-c74d8fd640c9', '7db0e37e-2bc1-4dff-8bba-c49179d57dbc'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:14 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:14 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:14 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD" returned: 0 in 0.957s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:14 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 is fetched for user 19b913daa7e949dea9d9a8a622c47fa4. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4727b825-03e4-4b58-b085-cc2c9bd49b7d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:15 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD Jul 09 02:57:15 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:15 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.795s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a372e6-e0ce-45fb-b504-6bd0dc8765f0 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-52d951f0-c537-4ae5-9a34-21748218f31b-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-0d9b2a4c-f08d-4993-91b6-2bb78348bbca-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-0d9b2a4c-f08d-4993-91b6-2bb78348bbca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-0d9b2a4c-f08d-4993-91b6-2bb78348bbca" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-0d9b2a4c-f08d-4993-91b6-2bb78348bbca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleting offline snapshot 0d9b2a4c-f08d-4993-91b6-2bb78348bbca of volume fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] snapshot_file for this snap is: volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb35ab-6931-4bd2-8dbd-a4ed5facb5ec]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:16 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca Jul 09 02:57:16 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:16 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1983293721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ee63b-7618-45da-8815-7e66b43a0458,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:13Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Creating volume 2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:16 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:16 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1073741824 Jul 09 02:57:16 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:17 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca" returned: 0 in 1.352s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd974f8d-1479-45e1-b2c1-552927050e5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[572cc1ac-98f1-406a-9bb2-514032913e7a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:17 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1073741824" returned: 0 in 1.276s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:17 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f Jul 09 02:57:17 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:17 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:17 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:18 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f" returned: 0 in 0.916s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:18 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca Jul 09 02:57:18 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:18 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 0 in 0.906s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Attempting download of db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 2a8ee63b-7618-45da-8815-7e66b43a0458. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[061772e9-08c2-4733-972d-ee6986ad5e55]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:18 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq Jul 09 02:57:18 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:19 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca" returned: 0 in 1.273s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:19 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca Jul 09 02:57:19 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:19 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq" returned: 0 in 1.040s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:19 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq Jul 09 02:57:19 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:20 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f.0d9b2a4c-f08d-4993-91b6-2bb78348bbca" returned: 0 in 0.930s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-0d9b2a4c-f08d-4993-91b6-2bb78348bbca" released by "_delete_snapshot" :: held 4.686s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" released by "delete_snapshot" :: held 4.735s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['8c4a5d91-6f1c-4cb0-9880-b575cc4e4243', '233aa689-9142-47c7-9336-c1003cb636d7', '7536de7a-236f-4c21-8225-4d37f2c6a552', '295a682c-ffcc-4574-98a7-24db6f1396ce'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Delete snapshot completed successfully. Jul 09 02:57:20 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4fc2e658-2a46-4745-97f1-ac1a02c627f8 tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-0d9b2a4c-f08d-4993-91b6-2bb78348bbca-delete_snapshot" released by "delete_snapshot" :: held 4.995s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq" returned: 1 in 1.260s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_8lf5tmmq' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3b3f5-2ad4-44b6-8dd9-47ead3f73267]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:21 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD Jul 09 02:57:21 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-fd974f8d-1479-45e1-b2c1-552927050e5f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-fd974f8d-1479-45e1-b2c1-552927050e5f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d59004-45d4-4b3a-b353-f93431c9c60d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:21 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f Jul 09 02:57:21 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:22 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD" returned: 0 in 1.460s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:22 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] db9c7883-aaf0-4c13-905a-75c00f73e5a1 was qcow2, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 02:57:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:22 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:22 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:22 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f" returned: 0 in 1.376s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:22 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f Jul 09 02:57:22 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:24 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fd974f8d-1479-45e1-b2c1-552927050e5f" returned: 0 in 1.328s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-quobyte-fd974f8d-1479-45e1-b2c1-552927050e5f" released by "delete_volume" :: held 2.832s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Created reservations ['405700a9-ef49-4e4a-a1b0-8946b0514c6f', '9ed98e88-dafe-443a-89ac-9559ce6ed8fc', 'ab4d32f2-7b9a-4920-997f-343657597862', '9db0e938-41a7-4760-8bf7-c86701be0a37'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:24 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:24 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:25 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.376s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Deleted volume successfully. Jul 09 02:57:25 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 0 in 3.691s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_3urly5tddevstack@QuobyteHD, size 112.00 MB, duration 3.69 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:57:25 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Converted 112.00 MB image at 30.33 MB/s Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-75029183-2681-4cb9-8faf-c19d9c099b3e tempest-CreateVolumesFromSnapshotTest-485363088 None] Lock "cinder-fd974f8d-1479-45e1-b2c1-552927050e5f-delete_volume" released by "delete_volume" :: held 4.676s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:26 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1G Jul 09 02:57:26 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:27 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 1G" returned: 0 in 1.076s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9154662c-ba81-4af4-9b45-9e3dbf16f50d]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:27 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:27 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:28 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:28 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:28 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 0 in 1.866s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:29 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:29 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:29 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.421s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:57:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:57:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:57:30 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 1 in 1.281s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Downloaded image db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 2a8ee63b-7618-45da-8815-7e66b43a0458 successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 for user 19b913daa7e949dea9d9a8a622c47fa4 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Marking volume 2a8ee63b-7618-45da-8815-7e66b43a0458 as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Copying metadata from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 to 2a8ee63b-7618-45da-8815-7e66b43a0458. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Creating volume glance metadata for volume 2a8ee63b-7618-45da-8815-7e66b43a0458 backed by image db9c7883-aaf0-4c13-905a-75c00f73e5a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ec0421-0d3b-44a4-b91d-c33c841d0f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8ee63b-7618-45da-8815-7e66b43a0458', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b4e66-34f8-4b31-91be-bc3909b44296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Volume volume-2a8ee63b-7618-45da-8815-7e66b43a0458 (2a8ee63b-7618-45da-8815-7e66b43a0458): created successfully Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b4e66-34f8-4b31-91be-bc3909b44296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (6d622d46-7829-443c-af6c-c7b467bbf9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-91c0d511-7a14-4d19-9c01-b334969682a4 tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Flow 'volume_create_manager' (86bbe597-ab3b-4825-9aad-5682583b5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4cb334-4fe2-4769-a895-70e33f9ac767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4cb334-4fe2-4769-a895-70e33f9ac767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645517028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4a9866-2649-4a51-a82e-6e4210033d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e20fe82e67c408f8addb386f927b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:32Z,use_quota=True,user_id='79efd09117d947a5846de7b306a0f887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62863a7e-0336-4630-8a8d-5c31213c34a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62863a7e-0336-4630-8a8d-5c31213c34a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f10650-800f-455c-914e-c97238b768c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f10650-800f-455c-914e-c97238b768c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4a9866-2649-4a51-a82e-6e4210033d05', 'volume_name': 'volume-8d4a9866-2649-4a51-a82e-6e4210033d05', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dedac20-ba1a-4302-ba0e-8082b9136df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dedac20-ba1a-4302-ba0e-8082b9136df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c02bcd7-758c-4ebb-95b6-6734ff2e0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Volume 8d4a9866-2649-4a51-a82e-6e4210033d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4a9866-2649-4a51-a82e-6e4210033d05', 'volume_size': 1} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645517028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4a9866-2649-4a51-a82e-6e4210033d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e20fe82e67c408f8addb386f927b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:32Z,use_quota=True,user_id='79efd09117d947a5846de7b306a0f887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Creating volume 8d4a9866-2649-4a51-a82e-6e4210033d05 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:31 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:31 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 1073741824 Jul 09 02:57:31 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (38f337e1-8fcf-41b9-91f6-67d18e6966f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dd352a-f6ac-4c0e-90df-cbfa8bf4e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dd352a-f6ac-4c0e-90df-cbfa8bf4e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-533589357',display_name='tempest-VolumesGetTest-Volume-1740521521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879233ce-0ae1-4710-83d2-73200f46f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:32Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f17d524-70c8-41be-b67b-c8ed0fcf8c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f17d524-70c8-41be-b67b-c8ed0fcf8c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35a5885-8122-45a8-8ee7-bdb77d136593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35a5885-8122-45a8-8ee7-bdb77d136593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879233ce-0ae1-4710-83d2-73200f46f6b2', 'volume_name': 'volume-879233ce-0ae1-4710-83d2-73200f46f6b2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d519ca2-37c5-4b07-9c56-96e1a1a89bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d519ca2-37c5-4b07-9c56-96e1a1a89bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:32 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69a605f-96ce-4228-a4f3-b73525c4625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:32 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Volume 879233ce-0ae1-4710-83d2-73200f46f6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879233ce-0ae1-4710-83d2-73200f46f6b2', 'volume_size': 1} Jul 09 02:57:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:32 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 1073741824" returned: 0 in 1.098s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:32 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 Jul 09 02:57:32 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:33 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05" returned: 0 in 0.718s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-533589357',display_name='tempest-VolumesGetTest-Volume-1740521521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879233ce-0ae1-4710-83d2-73200f46f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a846d2458418b9eba7a950c192581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:32Z,use_quota=True,user_id='19b913daa7e949dea9d9a8a622c47fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Creating volume 879233ce-0ae1-4710-83d2-73200f46f6b2 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:33 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c02bcd7-758c-4ebb-95b6-6734ff2e0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4a9866-2649-4a51-a82e-6e4210033d05', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6147e4e-e31d-44c5-ac5f-77bebafb83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:33 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 1073741824 Jul 09 02:57:33 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:33 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Volume volume-8d4a9866-2649-4a51-a82e-6e4210033d05 (8d4a9866-2649-4a51-a82e-6e4210033d05): created successfully Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6147e4e-e31d-44c5-ac5f-77bebafb83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Flow 'volume_create_manager' (86bbe597-ab3b-4825-9aad-5682583b5669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:33 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bd94f92e-6870-48da-996c-d8327824e2a0 tempest-ProjectReaderTests-2015906849 None] Created volume successfully. Jul 09 02:57:34 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 1073741824" returned: 0 in 0.999s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:34 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 Jul 09 02:57:34 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Acquiring lock "cinder-8d4a9866-2649-4a51-a82e-6e4210033d05-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "cinder-8d4a9866-2649-4a51-a82e-6e4210033d05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Acquiring lock "cinder-quobyte-8d4a9866-2649-4a51-a82e-6e4210033d05" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "cinder-quobyte-8d4a9866-2649-4a51-a82e-6e4210033d05" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c535ed-7fd4-44f9-915b-5cd54c497e80]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:35 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2" returned: 0 in 0.705s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:35 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 Jul 09 02:57:35 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69a605f-96ce-4228-a4f3-b73525c4625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879233ce-0ae1-4710-83d2-73200f46f6b2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce30a5bb-c227-4acf-98b3-7ddec72daac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:35 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Volume volume-879233ce-0ae1-4710-83d2-73200f46f6b2 (879233ce-0ae1-4710-83d2-73200f46f6b2): created successfully Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce30a5bb-c227-4acf-98b3-7ddec72daac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Flow 'volume_create_manager' (38f337e1-8fcf-41b9-91f6-67d18e6966f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5975f0de-8c37-4bbf-8b41-33acabad808d tempest-VolumesGetTest-185141038 None] Created volume successfully. Jul 09 02:57:36 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05" returned: 0 in 0.883s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:36 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05 Jul 09 02:57:36 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-879233ce-0ae1-4710-83d2-73200f46f6b2-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "cinder-879233ce-0ae1-4710-83d2-73200f46f6b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-879233ce-0ae1-4710-83d2-73200f46f6b2" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-879233ce-0ae1-4710-83d2-73200f46f6b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e614064-575b-47b6-a47f-366daea88e1e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:36 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 Jul 09 02:57:36 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:37 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8d4a9866-2649-4a51-a82e-6e4210033d05" returned: 0 in 0.974s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "cinder-quobyte-8d4a9866-2649-4a51-a82e-6e4210033d05" released by "delete_volume" :: held 1.914s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Created reservations ['8ec1414c-8b04-47a4-9216-e7a89f045299', '0cca6052-af06-421a-b52f-40f8f6dbe656', 'ba41d3f5-a93e-4811-9082-a2fcbc6601ea', '36e5d794-1af0-4ebf-97f7-f29ed1f0b790'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:37 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:37 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:37 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2" returned: 0 in 1.304s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:37 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2 Jul 09 02:57:37 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Flow 'volume_create_manager' (5c667605-37f4-47f6-98ef-d2d8c4a8c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6b615-5a38-48b4-96af-36f268e3338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6b615-5a38-48b4-96af-36f268e3338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592093340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bccd506-0d61-42dd-98dc-ec5c58504683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e20fe82e67c408f8addb386f927b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:38Z,use_quota=True,user_id='79efd09117d947a5846de7b306a0f887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9778b2-0531-4587-b32a-e4089a206f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9778b2-0531-4587-b32a-e4089a206f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd8c1de-0a9a-4d0a-9a9f-623ae8151a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd8c1de-0a9a-4d0a-9a9f-623ae8151a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bccd506-0d61-42dd-98dc-ec5c58504683', 'volume_name': 'volume-9bccd506-0d61-42dd-98dc-ec5c58504683', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9665744c-ca5a-4a14-ab75-73c477a2259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9665744c-ca5a-4a14-ab75-73c477a2259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60401cc-2370-483f-bed7-1925d8e39fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Volume 9bccd506-0d61-42dd-98dc-ec5c58504683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bccd506-0d61-42dd-98dc-ec5c58504683', 'volume_size': 1} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592093340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bccd506-0d61-42dd-98dc-ec5c58504683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e20fe82e67c408f8addb386f927b710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:38Z,use_quota=True,user_id='79efd09117d947a5846de7b306a0f887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Creating volume 9bccd506-0d61-42dd-98dc-ec5c58504683 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:38 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 1073741824 Jul 09 02:57:38 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:38 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.988s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Deleted volume successfully. Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-199c4e6b-5c8d-44a4-84ee-f657d6cca5e0 tempest-ProjectReaderTests-2015906849 None] Lock "cinder-8d4a9866-2649-4a51-a82e-6e4210033d05-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:38 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-879233ce-0ae1-4710-83d2-73200f46f6b2" returned: 0 in 0.937s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-879233ce-0ae1-4710-83d2-73200f46f6b2" released by "delete_volume" :: held 2.317s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Created reservations ['73c8f110-1c12-4e3d-b8c3-7a11dd4932cf', '7577d397-4f3f-4c91-a306-0ba4e896c63c', '31c1bb78-9ae7-4361-8eab-20bf7a7940f8', '6be7ef23-f527-48bd-b2bb-e304bfff894b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:38 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:38 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:39 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 1073741824" returned: 0 in 1.313s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:39 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 Jul 09 02:57:39 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:39 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.910s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3c02f772-b020-4527-8475-e7193141e5f9 tempest-VolumesGetTest-185141038 None] Lock "cinder-879233ce-0ae1-4710-83d2-73200f46f6b2-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-2a8ee63b-7618-45da-8815-7e66b43a0458-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "cinder-2a8ee63b-7618-45da-8815-7e66b43a0458-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Acquiring lock "cinder-quobyte-2a8ee63b-7618-45da-8815-7e66b43a0458" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-2a8ee63b-7618-45da-8815-7e66b43a0458" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[543375b1-c802-44bb-886c-6703aa067e65]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:40 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:40 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:40 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683" returned: 0 in 0.881s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60401cc-2370-483f-bed7-1925d8e39fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bccd506-0d61-42dd-98dc-ec5c58504683', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee173177-6e00-4bbc-b415-dd512f3f55bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:40 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Volume volume-9bccd506-0d61-42dd-98dc-ec5c58504683 (9bccd506-0d61-42dd-98dc-ec5c58504683): created successfully Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee173177-6e00-4bbc-b415-dd512f3f55bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Flow 'volume_create_manager' (5c667605-37f4-47f6-98ef-d2d8c4a8c246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7bdc4b3a-bec4-47ef-bc48-4ad818dccbed tempest-ProjectReaderTests-2015906849 None] Created volume successfully. Jul 09 02:57:41 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 0 in 1.124s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Acquiring lock "cinder-9bccd506-0d61-42dd-98dc-ec5c58504683-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:41 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:41 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "cinder-9bccd506-0d61-42dd-98dc-ec5c58504683-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Acquiring lock "cinder-quobyte-9bccd506-0d61-42dd-98dc-ec5c58504683" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "cinder-quobyte-9bccd506-0d61-42dd-98dc-ec5c58504683" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac49f2c-1f86-48a4-8b3e-3fd571c43f01]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:41 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 Jul 09 02:57:41 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:42 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 1 in 1.028s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:57:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:42 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458 Jul 09 02:57:42 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:42 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683" returned: 0 in 1.090s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:42 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683 Jul 09 02:57:42 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:43 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2a8ee63b-7618-45da-8815-7e66b43a0458" returned: 0 in 0.780s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "cinder-quobyte-2a8ee63b-7618-45da-8815-7e66b43a0458" released by "delete_volume" :: held 3.029s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=148,cinder:SELECT=104,cinder:DELETE=9,cinder:INSERT=38 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=135,cinder:SELECT=97,cinder:INSERT=43,cinder:DELETE=15 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Created reservations ['afe81ad3-6ecc-4f94-88c3-970dfd41b7d3', 'efdd2c6a-bd17-43c3-875b-33b933da0a9e', 'a69abb8b-4075-44f5-8e16-9c7d00d335be', 'dadf883b-83e9-48f2-990c-9a88be783d01'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:43 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:43 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:43 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9bccd506-0d61-42dd-98dc-ec5c58504683" returned: 0 in 0.775s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "cinder-quobyte-9bccd506-0d61-42dd-98dc-ec5c58504683" released by "delete_volume" :: held 1.927s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Created reservations ['6e47b968-88b1-4626-ba6d-3818bcb2a5f5', '885a1399-285d-493b-ab10-9a96a289af86', '4f46e578-7700-49d1-a6bc-310cc142c341', 'da59bc6f-d420-48f3-baa5-a640d1f811f0'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:43 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:57:43 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:44 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.899s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Deleted volume successfully. Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ba6ce2c7-5f87-4ec1-a8f6-137c0cbba8d9 tempest-VolumesGetTest-185141038 None] Lock "cinder-2a8ee63b-7618-45da-8815-7e66b43a0458-delete_volume" released by "delete_volume" :: held 4.245s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:44 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.022s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:57:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Deleted volume successfully. Jul 09 02:57:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ebdc6f5-cdbf-4127-aa71-714d9b914a2b tempest-ProjectReaderTests-2015906849 None] Lock "cinder-9bccd506-0d61-42dd-98dc-ec5c58504683-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:57:45 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Flow 'volume_create_manager' (a13894de-58db-42c0-8d14-db9a276a8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b6d697-6a1d-4ff3-943b-f9f3fc63f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b6d697-6a1d-4ff3-943b-f9f3fc63f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2029319103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c03729e-0f0e-404e-833a-051256148a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8df5635b5134976b2b3e7d8d148f831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:46Z,use_quota=True,user_id='f38f1752d33849f9b4923c1c8aa944b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6489ba-b987-485d-8115-9a4d01865b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6489ba-b987-485d-8115-9a4d01865b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ecb233-2b8c-4ded-ab65-bd44e3d1c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ecb233-2b8c-4ded-ab65-bd44e3d1c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c03729e-0f0e-404e-833a-051256148a0e', 'volume_name': 'volume-3c03729e-0f0e-404e-833a-051256148a0e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576f5979-fc89-48b8-a3e9-70d5c7c5b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576f5979-fc89-48b8-a3e9-70d5c7c5b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4012fcad-bc26-4ee9-9806-7a132a163b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Volume 3c03729e-0f0e-404e-833a-051256148a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c03729e-0f0e-404e-833a-051256148a0e', 'volume_size': 1} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2029319103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c03729e-0f0e-404e-833a-051256148a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8df5635b5134976b2b3e7d8d148f831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:46Z,use_quota=True,user_id='f38f1752d33849f9b4923c1c8aa944b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Creating volume 3c03729e-0f0e-404e-833a-051256148a0e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:46 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:46 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e 1073741824 Jul 09 02:57:46 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:47 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e 1073741824" returned: 0 in 1.091s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:47 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e Jul 09 02:57:47 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:47 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:57:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Flow 'volume_create_manager' (308cd2d6-981d-4bde-908f-f6156a587a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553cd644-ccd9-4b4d-bab4-45f5e0c4443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553cd644-ccd9-4b4d-bab4-45f5e0c4443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-619904252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d41cb8-f96c-4d02-8802-fca1c75956af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f2aa33e7f0456d890481e9bc726abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:48Z,use_quota=True,user_id='86f31ddc933243df8bcb5938443e5129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26465e9-39ad-43ee-8847-e4bc443ca9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26465e9-39ad-43ee-8847-e4bc443ca9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0f4aa-d29f-4ebc-9063-1b0a39087b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0f4aa-d29f-4ebc-9063-1b0a39087b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d41cb8-f96c-4d02-8802-fca1c75956af', 'volume_name': 'volume-e7d41cb8-f96c-4d02-8802-fca1c75956af', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf6ea1e-e5a8-43cf-8f3f-7ac9114f9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf6ea1e-e5a8-43cf-8f3f-7ac9114f9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b7ce3-6489-4e66-ad81-4017e46d0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Volume e7d41cb8-f96c-4d02-8802-fca1c75956af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d41cb8-f96c-4d02-8802-fca1c75956af', 'volume_size': 1} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e" returned: 0 in 0.857s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-619904252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d41cb8-f96c-4d02-8802-fca1c75956af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f2aa33e7f0456d890481e9bc726abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:57:48Z,use_quota=True,user_id='86f31ddc933243df8bcb5938443e5129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Creating volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:57:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:48 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af 1073741824 Jul 09 02:57:48 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4012fcad-bc26-4ee9-9806-7a132a163b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c03729e-0f0e-404e-833a-051256148a0e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fed80a-c36a-4e68-b2cd-32c2c3175fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Volume volume-3c03729e-0f0e-404e-833a-051256148a0e (3c03729e-0f0e-404e-833a-051256148a0e): created successfully Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fed80a-c36a-4e68-b2cd-32c2c3175fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Flow 'volume_create_manager' (a13894de-58db-42c0-8d14-db9a276a8235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-98c2e0f8-f4ff-4ddf-8d62-3ec373b62486 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Created volume successfully. Jul 09 02:57:49 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af 1073741824" returned: 0 in 0.938s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:49 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af Jul 09 02:57:49 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:49 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af" returned: 0 in 0.695s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b7ce3-6489-4e66-ad81-4017e46d0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d41cb8-f96c-4d02-8802-fca1c75956af', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3c38e-a89c-45d6-9ed3-741c5a8b978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:57:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Volume volume-e7d41cb8-f96c-4d02-8802-fca1c75956af (e7d41cb8-f96c-4d02-8802-fca1c75956af): created successfully Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3c38e-a89c-45d6-9ed3-741c5a8b978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:57:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Flow 'volume_create_manager' (308cd2d6-981d-4bde-908f-f6156a587a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:57:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-49208edd-ce99-4183-94f4-bfddee90fae5 tempest-VolumesSnapshotListTestJSON-1843293377 None] Created volume successfully. Jul 09 02:57:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Creating offline snapshot 2fd3d1a7-2493-4849-80c3-85f54b95b116 of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:57:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85b7ea9-99bd-4362-953f-721ccc457f28]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:51 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af Jul 09 02:57:51 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:52 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af" returned: 0 in 1.272s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:52 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 1G Jul 09 02:57:52 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:53 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 1G" returned: 0 in 1.023s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:53 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:57:53 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:54 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 0.786s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:54 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 is being set with open permissions: ugo+rw Jul 09 02:57:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:54 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:57:54 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:55 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 0.739s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:55 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info Jul 09 02:57:55 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:56 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info" returned: 0 in 0.870s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:56 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info is being set with open permissions: ugo+rw Jul 09 02:57:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:56 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info Jul 09 02:57:56 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:57 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.info" returned: 0 in 0.919s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.719s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.183s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:57 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74526f4-de23-4d55-93b0-e228f77124d5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9348ceeb-ab9b-481b-a208-4c818fd61358 tempest-VolumesSnapshotListTestJSON-1843293377 None] Create snapshot completed successfully Jul 09 02:57:57 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e Jul 09 02:57:57 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:57:58 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e" returned: 0 in 1.058s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.120s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.205s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Creating offline snapshot 599280eb-8491-4dd1-9cfd-f23817bddb02 of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9dd016-fd95-444e-a41b-749cf92eaa86]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-3c03729e-0f0e-404e-833a-051256148a0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f9d4a19-9d11-487c-a6b0-f9638a54bce4', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:57:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-7a428bac-a07b-4615-88b7-1af7d73e194e req-056fa3d0-99d5-450e-89fe-e273e730c432 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] attachment_update completed successfully. Jul 09 02:57:58 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:57:58 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:57:59 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 09 02:57:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 1.109s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:57:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:57:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:57:59 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 1G Jul 09 02:57:59 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:00 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 1G" returned: 0 in 1.506s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:00 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:00 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (163ab5f3-1e0b-4176-a851-fcdb14fa8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2513502-ff98-408f-90a1-609eb5a7e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2513502-ff98-408f-90a1-609eb5a7e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448407855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef913ffa-46d0-4be0-af92-2458d6d5af95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:02Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7c7a14-e9dd-4c73-8013-30deb6ed0837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7c7a14-e9dd-4c73-8013-30deb6ed0837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853570d3-4fd1-4872-8348-ea0a12d8aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853570d3-4fd1-4872-8348-ea0a12d8aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef913ffa-46d0-4be0-af92-2458d6d5af95', 'volume_name': 'volume-ef913ffa-46d0-4be0-af92-2458d6d5af95', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b52b2f-cdd4-4b2a-ba14-4fc9afcb0898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b52b2f-cdd4-4b2a-ba14-4fc9afcb0898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e527a1-16a8-4f40-a8e0-3a83af963023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:02 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Volume ef913ffa-46d0-4be0-af92-2458d6d5af95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef913ffa-46d0-4be0-af92-2458d6d5af95', 'volume_size': 1} Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:02 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 1.589s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:02 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 is being set with open permissions: ugo+rw Jul 09 02:58:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:02 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:02 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:03 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 0.898s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.241s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448407855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef913ffa-46d0-4be0-af92-2458d6d5af95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:02Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Creating volume ef913ffa-46d0-4be0-af92-2458d6d5af95 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:03 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:03 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 1073741824 Jul 09 02:58:03 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f2214803-20b7-40fc-917c-36b588894da1 tempest-VolumesSnapshotListTestJSON-1843293377 None] Create snapshot completed successfully Jul 09 02:58:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:04 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 1073741824" returned: 0 in 1.432s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:04 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 Jul 09 02:58:04 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:05 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95" returned: 0 in 1.013s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.139s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:05 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e527a1-16a8-4f40-a8e0-3a83af963023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef913ffa-46d0-4be0-af92-2458d6d5af95', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a1e35b-0bc5-49d0-817a-746c0039120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Creating offline snapshot 2936e6d4-abc8-4290-8365-e3868308988a of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:58:06 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Volume volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 (ef913ffa-46d0-4be0-af92-2458d6d5af95): created successfully Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a1e35b-0bc5-49d0-817a-746c0039120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (163ab5f3-1e0b-4176-a851-fcdb14fa8975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb2c89-6ae5-4990-9f07-3605173a5ef2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-54b2695d-a55d-4c49-8583-1b8512938123 tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:58:06 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:06 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-34b5d469-6656-4e02-ac92-38ec904f4855 tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95" by "attach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-34b5d469-6656-4e02-ac92-38ec904f4855 tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95" acquired by "attach_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34b5d469-6656-4e02-ac92-38ec904f4855 tempest-VolumesActionsTest-191724911 None] Attaching volume ef913ffa-46d0-4be0-af92-2458d6d5af95 to instance ca48173f-b285-4a0a-9a44-803d26d16c60 at mountpoint /dev/vdb on host None. Jul 09 02:58:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-34b5d469-6656-4e02-ac92-38ec904f4855 tempest-VolumesActionsTest-191724911 None] Attach volume completed successfully. Jul 09 02:58:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-34b5d469-6656-4e02-ac92-38ec904f4855 tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95" released by "attach_volume" :: held 0.189s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:07 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 1.264s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:07 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-a27a50e6-8e6e-4576-842f-331397a5440a req-54601210-675b-4079-a324-3a6ed81e2240 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Terminate volume connection completed successfully. Jul 09 02:58:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-a27a50e6-8e6e-4576-842f-331397a5440a req-54601210-675b-4079-a324-3a6ed81e2240 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Deleting attachment 8f9d4a19-9d11-487c-a6b0-f9638a54bce4. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 02:58:07 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a 1G Jul 09 02:58:07 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Terminate volume connection completed successfully. Jul 09 02:58:08 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a 1G" returned: 0 in 1.170s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:08 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a Jul 09 02:58:08 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" by "detach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Detaching volume ef913ffa-46d0-4be0-af92-2458d6d5af95 from instance ca48173f-b285-4a0a-9a44-803d26d16c60. Jul 09 02:58:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Detach volume completed successfully. Jul 09 02:58:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c57949c0-105e-428f-b2a3-4ace2b28b497 tempest-VolumesActionsTest-112188859 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-18b2d1e9-8d25-4320-ab3c-efb2167da17d tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" by "detach_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-18b2d1e9-8d25-4320-ab3c-efb2167da17d tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-18b2d1e9-8d25-4320-ab3c-efb2167da17d tempest-VolumesActionsTest-191724911 None] Volume detach called, but volume not attached. Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-18b2d1e9-8d25-4320-ab3c-efb2167da17d tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "cinder-3c03729e-0f0e-404e-833a-051256148a0e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "cinder-3c03729e-0f0e-404e-833a-051256148a0e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "cinder-quobyte-3c03729e-0f0e-404e-833a-051256148a0e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:09 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a" returned: 0 in 1.239s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:09 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a is being set with open permissions: ugo+rw Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "cinder-quobyte-3c03729e-0f0e-404e-833a-051256148a0e" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:09 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a Jul 09 02:58:09 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed855b6a-abfb-491a-9173-23159e854825]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:10 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e Jul 09 02:58:10 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-quobyte-ef913ffa-46d0-4be0-af92-2458d6d5af95" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "cinder-quobyte-ef913ffa-46d0-4be0-af92-2458d6d5af95" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f0927-9e61-446f-9e42-7daa09fa3ce8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:10 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 Jul 09 02:58:10 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:10 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a" returned: 0 in 1.143s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b5deb11d-2bfc-49f7-85bf-4aa1705494f9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Create snapshot completed successfully Jul 09 02:58:11 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e" returned: 0 in 1.552s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:11 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e Jul 09 02:58:11 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:12 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95" returned: 0 in 1.379s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:12 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95 Jul 09 02:58:12 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-2936e6d4-abc8-4290-8365-e3868308988a-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-2936e6d4-abc8-4290-8365-e3868308988a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-2936e6d4-abc8-4290-8365-e3868308988a" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-2936e6d4-abc8-4290-8365-e3868308988a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Deleting offline snapshot 2936e6d4-abc8-4290-8365-e3868308988a of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] snapshot_file for this snap is: volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:58:12 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3c03729e-0f0e-404e-833a-051256148a0e" returned: 0 in 1.189s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fb7a37-5542-4c74-9a72-666a2854b9a1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "cinder-quobyte-3c03729e-0f0e-404e-833a-051256148a0e" released by "delete_volume" :: held 2.816s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Created reservations ['dfbca2a9-f4db-442d-9059-8a5e519623cf', '5cf08f61-c09e-4cce-bda8-960479a6dfa8', '3e66730c-4608-43be-89e5-4b673d82db3a', 'a733fde9-14a2-4e7f-b19f-fca6f35d291d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:12 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a Jul 09 02:58:12 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:12 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:12 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:12 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ef913ffa-46d0-4be0-af92-2458d6d5af95" returned: 0 in 0.943s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "cinder-quobyte-ef913ffa-46d0-4be0-af92-2458d6d5af95" released by "delete_volume" :: held 2.411s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Created reservations ['3293547a-9ba0-47fd-9a52-a764003e05d8', 'bfb80fac-ad8a-4ec2-8a3a-de79002479f1', 'f0b7f90e-12b2-4d8d-9eef-217e6e0dcb30', '4a39078a-7178-4b7a-a125-3dfc6ae1714c'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:13 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:13 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:13 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a" returned: 0 in 0.998s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b342f1-f52e-40bc-ae36-19e3d573c06b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:13 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:13 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:13 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.102s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Deleted volume successfully. Jul 09 02:58:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3f3c756f-be23-424e-b843-43c8b8221f01 tempest-TestServerVolumeAttachScenarioOldVersion-243765735 None] Lock "cinder-3c03729e-0f0e-404e-833a-051256148a0e-delete_volume" released by "delete_volume" :: held 4.320s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:14 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.148s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Deleted volume successfully. Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-431668ac-3432-479e-a539-60a15eff4d42 tempest-VolumesActionsTest-191724911 None] Lock "cinder-ef913ffa-46d0-4be0-af92-2458d6d5af95-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:14 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 1.023s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:14 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a Jul 09 02:58:14 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:15 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a" returned: 0 in 1.183s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:15 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a Jul 09 02:58:15 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:16 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2936e6d4-abc8-4290-8365-e3868308988a" returned: 0 in 0.914s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-2936e6d4-abc8-4290-8365-e3868308988a" released by "_delete_snapshot" :: held 4.299s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" released by "delete_snapshot" :: held 4.333s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:16 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Created reservations ['2b04740f-8b89-48c2-b017-35ab9213c714', '52710e47-4f6f-4d3c-80aa-2359e15d84ae', 'cc4cff88-bcf9-4b32-a367-6a9f903ec8b6', '14b9ea61-b107-4422-8132-08f7ed430f97'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Delete snapshot completed successfully. Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d681b208-d211-46cb-b5c1-58ff66be16c9 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-2936e6d4-abc8-4290-8365-e3868308988a-delete_snapshot" released by "delete_snapshot" :: held 4.620s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-599280eb-8491-4dd1-9cfd-f23817bddb02-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-599280eb-8491-4dd1-9cfd-f23817bddb02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-599280eb-8491-4dd1-9cfd-f23817bddb02" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-599280eb-8491-4dd1-9cfd-f23817bddb02" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Deleting offline snapshot 599280eb-8491-4dd1-9cfd-f23817bddb02 of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] snapshot_file for this snap is: volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b17ea-ef80-491e-a917-f412140fdeed]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:18 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:18 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:18 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 0.965s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[36acabe2-e1d8-445b-a866-a33983a30559]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:19 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:58:19 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:19 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:19 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:19 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:20 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 0.881s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:20 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02 Jul 09 02:58:20 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:21 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.599280eb-8491-4dd1-9cfd-f23817bddb02" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-599280eb-8491-4dd1-9cfd-f23817bddb02" released by "_delete_snapshot" :: held 3.620s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" released by "delete_snapshot" :: held 3.647s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Created reservations ['e360c4dd-9e1e-4984-b195-7aa200e826ce', 'ae8d265a-6da1-42b7-8fe0-4c72ae395228', 'ab63f47e-c068-40c4-a65b-99a80666b06e', 'ac8026b2-c0f9-4e5f-8a00-4930550fd883'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Delete snapshot completed successfully. Jul 09 02:58:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7cfb3eb3-120f-4b9c-81c7-74cda16abf4b tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-599280eb-8491-4dd1-9cfd-f23817bddb02-delete_snapshot" released by "delete_snapshot" :: held 3.827s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-2fd3d1a7-2493-4849-80c3-85f54b95b116-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-2fd3d1a7-2493-4849-80c3-85f54b95b116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-2fd3d1a7-2493-4849-80c3-85f54b95b116" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-2fd3d1a7-2493-4849-80c3-85f54b95b116" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Deleting offline snapshot 2fd3d1a7-2493-4849-80c3-85f54b95b116 of volume e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] snapshot_file for this snap is: volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7f309-e9e6-4ad6-aa60-8ccf2450380b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:22 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:58:22 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:23 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 1.067s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d41cb8-f96c-4d02-8802-fca1c75956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[66400637-c468-47bb-bb30-5c6df1197cce]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:23 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af Jul 09 02:58:23 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (16b8ed99-a579-41f3-8fba-a8f277fd9f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686de9de-3f61-49fd-8055-33f725868cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686de9de-3f61-49fd-8055-33f725868cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706368769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79789fce-38ff-4528-bec9-3100d6a440d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:23Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a6408-8139-4cac-849f-e8a65af87cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a6408-8139-4cac-849f-e8a65af87cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc3d5b-8f0e-4127-ab99-b5d48dbf7906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc3d5b-8f0e-4127-ab99-b5d48dbf7906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79789fce-38ff-4528-bec9-3100d6a440d9', 'volume_name': 'volume-79789fce-38ff-4528-bec9-3100d6a440d9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0053b-a17a-4a69-8d0c-4b6a97212e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0053b-a17a-4a69-8d0c-4b6a97212e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6be23e-49ae-4afb-ad36-849222ccae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:23 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Volume 79789fce-38ff-4528-bec9-3100d6a440d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79789fce-38ff-4528-bec9-3100d6a440d9', 'volume_size': 1} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706368769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79789fce-38ff-4528-bec9-3100d6a440d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:23Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Creating volume 79789fce-38ff-4528-bec9-3100d6a440d9 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:23 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:23 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 1073741824 Jul 09 02:58:23 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Flow 'volume_create_manager' (eaf44f33-9b66-4770-8a05-1ca4ccc09087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a310e35-9ecc-46be-8dac-dae1f5290d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a310e35-9ecc-46be-8dac-dae1f5290d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1114505136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9769f41177314cbb92e4f8253720393a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:24Z,use_quota=True,user_id='5e9c51995afe444190f31292753cef30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4374669d-0508-4b39-9659-a5cba50defb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4374669d-0508-4b39-9659-a5cba50defb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96a008d-c4d0-4664-9c18-da717b4cbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96a008d-c4d0-4664-9c18-da717b4cbfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a', 'volume_name': 'volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f732660c-3e23-412b-b2e9-357ffbddf230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:24 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f732660c-3e23-412b-b2e9-357ffbddf230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e150ba-4af4-4e52-8da7-f05411a394e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Volume 432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a', 'volume_size': 1} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af" returned: 0 in 1.057s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:24 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:58:24 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:24 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 1073741824" returned: 0 in 1.015s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:24 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 Jul 09 02:58:24 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:25 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 0.824s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:25 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116 Jul 09 02:58:25 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:25 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9" returned: 0 in 0.739s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1114505136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9769f41177314cbb92e4f8253720393a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:24Z,use_quota=True,user_id='5e9c51995afe444190f31292753cef30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Creating volume 432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:25 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:25 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a 1073741824 Jul 09 02:58:25 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6be23e-49ae-4afb-ad36-849222ccae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79789fce-38ff-4528-bec9-3100d6a440d9', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4f0529-bc8c-4555-9732-dd11a791a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Volume volume-79789fce-38ff-4528-bec9-3100d6a440d9 (79789fce-38ff-4528-bec9-3100d6a440d9): created successfully Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4f0529-bc8c-4555-9732-dd11a791a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (16b8ed99-a579-41f3-8fba-a8f277fd9f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6a315293-dc64-445c-bf31-0b80e97d7571 tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:58:26 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af.2fd3d1a7-2493-4849-80c3-85f54b95b116" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-2fd3d1a7-2493-4849-80c3-85f54b95b116" released by "_delete_snapshot" :: held 3.935s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" released by "delete_snapshot" :: held 3.968s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Created reservations ['8647dc71-dd04-4af8-93c9-8996db1b361b', 'd3ea2618-27b7-4826-a7ec-84c9f3073d82', 'f1f5e674-3272-414a-b508-d7a11ae1bd2b', '2a2b6e6f-2275-4149-b12f-da5651963d27'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Delete snapshot completed successfully. Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f8b8f16c-a6cb-445f-8307-840b6fc25e00 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-2fd3d1a7-2493-4849-80c3-85f54b95b116-delete_snapshot" released by "delete_snapshot" :: held 4.154s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:26 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-e7d41cb8-f96c-4d02-8802-fca1c75956af-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a 1073741824" returned: 0 in 1.052s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-e7d41cb8-f96c-4d02-8802-fca1c75956af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:26 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:26 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a82f380-47c8-49f3-af6a-fc0513338233]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:26 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af Jul 09 02:58:26 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-79789fce-38ff-4528-bec9-3100d6a440d9-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "cinder-79789fce-38ff-4528-bec9-3100d6a440d9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-quobyte-79789fce-38ff-4528-bec9-3100d6a440d9" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-79789fce-38ff-4528-bec9-3100d6a440d9" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb4d9ad-72d0-450e-b86d-65455da971b5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:27 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 Jul 09 02:58:27 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:27 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 0.995s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e150ba-4af4-4e52-8da7-f05411a394e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80034460-459a-496a-8830-ff2bfa8f005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Volume volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a (432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a): created successfully Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80034460-459a-496a-8830-ff2bfa8f005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Flow 'volume_create_manager' (eaf44f33-9b66-4770-8a05-1ca4ccc09087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9b658492-bf7c-4e07-a697-72e52f75cad5 tempest-SnapshotDependencyTests-2075072668 None] Created volume successfully. Jul 09 02:58:27 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af" returned: 0 in 1.078s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:27 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af Jul 09 02:58:27 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:27 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:27 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:28 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9" returned: 0 in 0.925s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:28 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9 Jul 09 02:58:28 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:28 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7d41cb8-f96c-4d02-8802-fca1c75956af" returned: 0 in 0.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-quobyte-e7d41cb8-f96c-4d02-8802-fca1c75956af" released by "delete_volume" :: held 1.983s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Created reservations ['49334051-ca24-42e9-b271-6610a003d14b', '71284a5c-aa66-48fe-bcbd-f7da9e311204', 'c777ed97-5680-4e63-9372-05163e164a27', '4a6f7845-a426-47c8-b4fa-15af2720eda9'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:28 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.915s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:29 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:29 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Creating offline snapshot 16ce4f60-31c3-4866-b0cd-765f8b044adf of volume 432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff6a3c-3116-470c-8bc1-316c3bc6fad1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:29 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79789fce-38ff-4528-bec9-3100d6a440d9" returned: 0 in 1.138s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-79789fce-38ff-4528-bec9-3100d6a440d9" released by "delete_volume" :: held 2.131s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:29 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:29 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Created reservations ['abc79ab4-4eab-407d-90cb-c91a3d4c8294', 'ddd0c3dd-a9f6-4a57-8daa-a5aff1d413d8', '35c839a6-94f0-46d6-a551-cebd28e433be', 'ef9c922c-9122-4806-addb-0a1f91ce73d7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:29 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:29 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:29 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.923s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Deleted volume successfully. Jul 09 02:58:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ebfe3256-4938-42b6-8246-286aa58624d8 tempest-VolumesSnapshotListTestJSON-1843293377 None] Lock "cinder-e7d41cb8-f96c-4d02-8802-fca1c75956af-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:30 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 1.085s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:30 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf 1G Jul 09 02:58:30 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:30 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.999s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:30 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Deleted volume successfully. Jul 09 02:58:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe09ec74-db2f-4795-b81e-b7a44e6d536c tempest-VolumesActionsTest-112188859 None] Lock "cinder-79789fce-38ff-4528-bec9-3100d6a440d9-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (c176b4ad-efe4-4b09-9ad8-765867707b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f7fd7-7a36-4684-9260-637f5118d8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f7fd7-7a36-4684-9260-637f5118d8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301620829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1720cc7b-e72b-41d5-b704-6c523e4bd614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:31Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1407351-d138-4176-8273-2c5e7354900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1407351-d138-4176-8273-2c5e7354900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f161d09-6a8a-4840-97cd-aa869d79f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f161d09-6a8a-4840-97cd-aa869d79f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1720cc7b-e72b-41d5-b704-6c523e4bd614', 'volume_name': 'volume-1720cc7b-e72b-41d5-b704-6c523e4bd614', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146b69ee-5a3a-4be0-8778-498544f4af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146b69ee-5a3a-4be0-8778-498544f4af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626bb652-c6d7-4256-9fc3-ca4b31f92ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Volume 1720cc7b-e72b-41d5-b704-6c523e4bd614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1720cc7b-e72b-41d5-b704-6c523e4bd614', 'volume_size': 1} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:31 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf 1G" returned: 0 in 1.293s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:31 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:31 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:32 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 0.948s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:32 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf is being set with open permissions: ugo+rw Jul 09 02:58:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:32 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:32 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:33 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:33 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info Jul 09 02:58:33 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:33 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info" returned: 0 in 0.725s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:33 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info is being set with open permissions: ugo+rw Jul 09 02:58:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:33 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info Jul 09 02:58:33 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:34 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.info" returned: 0 in 0.746s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.693s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.381s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301620829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1720cc7b-e72b-41d5-b704-6c523e4bd614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:31Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Creating volume 1720cc7b-e72b-41d5-b704-6c523e4bd614 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:34 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-98eec097-eaf3-47bb-b1bb-bb6a2d5ac0c8 tempest-SnapshotDependencyTests-2075072668 None] Create snapshot completed successfully Jul 09 02:58:34 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 1073741824 Jul 09 02:58:34 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:35 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 1073741824" returned: 0 in 1.222s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:36 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 Jul 09 02:58:36 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Flow 'volume_create_manager' (bf06d5d4-d8b8-4544-aa59-e8e051551873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d890caaf-6d4a-4084-a2ac-470d78d490df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d890caaf-6d4a-4084-a2ac-470d78d490df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21325e39-1f6e-4937-b934-f229704a34c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9769f41177314cbb92e4f8253720393a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16ce4f60-31c3-4866-b0cd-765f8b044adf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:36Z,use_quota=True,user_id='5e9c51995afe444190f31292753cef30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9488fc0c-274a-4b8a-af9e-55ee0027cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9488fc0c-274a-4b8a-af9e-55ee0027cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824c3b99-8750-4f5e-8b85-30582a9c43d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824c3b99-8750-4f5e-8b85-30582a9c43d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21325e39-1f6e-4937-b934-f229704a34c8', 'volume_name': 'volume-21325e39-1f6e-4937-b934-f229704a34c8', 'volume_size': 1, 'snapshot_id': '16ce4f60-31c3-4866-b0cd-765f8b044adf'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4946bd8-574d-4b8b-bcf1-8d2d760570ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4946bd8-574d-4b8b-bcf1-8d2d760570ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb78199f-e0d4-4d6e-bafa-a7d1a12aa278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Volume 21325e39-1f6e-4937-b934-f229704a34c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21325e39-1f6e-4937-b934-f229704a34c8', 'volume_size': 1, 'snapshot_id': '16ce4f60-31c3-4866-b0cd-765f8b044adf'} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:36 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.474s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf-21325e39-1f6e-4937-b934-f229704a34c8" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626bb652-c6d7-4256-9fc3-ca4b31f92ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1720cc7b-e72b-41d5-b704-6c523e4bd614', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4f5452-2581-4282-a5c7-b182cc10cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf-21325e39-1f6e-4937-b934-f229704a34c8" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Creating volume 21325e39-1f6e-4937-b934-f229704a34c8 from snapshot 16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:36 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Volume volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 (1720cc7b-e72b-41d5-b704-6c523e4bd614): created successfully Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4f5452-2581-4282-a5c7-b182cc10cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (c176b4ad-efe4-4b09-9ad8-765867707b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] snapshot: 16ce4f60-31c3-4866-b0cd-765f8b044adf, volume: 21325e39-1f6e-4937-b934-f229704a34c8, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 02:58:36 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d0708fc7-1f25-4818-9668-fdd5bb75c9c8 tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa559a-d5f8-4b11-9bf1-7f23ad214e0e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:37 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:37 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-1720cc7b-e72b-41d5-b704-6c523e4bd614-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "cinder-1720cc7b-e72b-41d5-b704-6c523e4bd614-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-quobyte-1720cc7b-e72b-41d5-b704-6c523e4bd614" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-1720cc7b-e72b-41d5-b704-6c523e4bd614" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a4ea4-6685-40c8-bb10-c4b8dae464b7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:38 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 1.096s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d975d40-40ea-4c28-a808-ed291ad5e501]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:38 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 Jul 09 02:58:38 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:38 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:38 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:39 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614" returned: 0 in 1.082s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:39 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614 Jul 09 02:58:39 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:39 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 1.060s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:39 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 02:58:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:39 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 Jul 09 02:58:39 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:40 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1720cc7b-e72b-41d5-b704-6c523e4bd614" returned: 0 in 1.172s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-1720cc7b-e72b-41d5-b704-6c523e4bd614" released by "delete_volume" :: held 2.377s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Created reservations ['a9b97a92-cb8b-418a-9c99-7c49e2d44c34', 'a907379a-c949-4026-8f02-0b1654b2157f', '8de6532e-9fd5-41f3-9544-e3144f29b5b1', '8ffb9956-4e75-450f-b31a-2b516fe594e7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:40 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:40 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:42 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.619s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:42 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Deleted volume successfully. Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ea3317d3-2900-48b0-96e1-f8656bfdcc86 tempest-VolumesActionsTest-112188859 None] Lock "cinder-1720cc7b-e72b-41d5-b704-6c523e4bd614-delete_volume" released by "delete_volume" :: held 4.547s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (5f290e10-0d55-41e0-9693-419ee2dd07f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f640677-aa5c-4138-8ca7-ca6ec24f5078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f640677-aa5c-4138-8ca7-ca6ec24f5078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1957883011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0223fb-cbc6-4598-ab3c-6694e8e33786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:43Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41111ce-aeed-4d0b-94db-6c3283fb4749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41111ce-aeed-4d0b-94db-6c3283fb4749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ad79a4-9e28-4153-a7c2-e4f484f3d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ad79a4-9e28-4153-a7c2-e4f484f3d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0223fb-cbc6-4598-ab3c-6694e8e33786', 'volume_name': 'volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d5d9df-d0b5-4dca-9dd5-b34f42514ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d5d9df-d0b5-4dca-9dd5-b34f42514ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972da4d8-9e11-49cb-83b1-4aab00c71a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Volume fe0223fb-cbc6-4598-ab3c-6694e8e33786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786', 'volume_size': 1} Jul 09 02:58:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:46 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8" returned: 0 in 7.127s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b5e33-2848-4a05-8adc-dedb3ec599c7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:46 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:46 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:47 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 1.054s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:47 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:58:47 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Converted 1024.00 MB image at 143.66 MB/s Jul 09 02:58:47 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 is being set with open permissions: ugo+rw Jul 09 02:58:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:47 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 Jul 09 02:58:47 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:48 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" released by "_copy_volume_from_snapshot" :: held 11.171s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf-21325e39-1f6e-4937-b934-f229704a34c8" released by "_create_volume_from_snapshot" :: held 11.223s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.264s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.992s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1957883011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0223fb-cbc6-4598-ab3c-6694e8e33786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:43Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Creating volume fe0223fb-cbc6-4598-ab3c-6694e8e33786 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:INSERT=25,cinder:UPDATE=98,cinder:SELECT=93,cinder:DELETE=11 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=84,cinder:INSERT=25,cinder:UPDATE=105,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:58:48 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 1073741824 Jul 09 02:58:48 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb78199f-e0d4-4d6e-bafa-a7d1a12aa278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21325e39-1f6e-4937-b934-f229704a34c8', 'volume_size': 1, 'snapshot_id': '16ce4f60-31c3-4866-b0cd-765f8b044adf'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f942c0-0387-4852-b9fa-eb97aab1902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Volume volume-21325e39-1f6e-4937-b934-f229704a34c8 (21325e39-1f6e-4937-b934-f229704a34c8): created successfully Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f942c0-0387-4852-b9fa-eb97aab1902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Flow 'volume_create_manager' (bf06d5d4-d8b8-4544-aa59-e8e051551873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a708b706-69c7-47a7-b8c9-de3fd0716178 tempest-SnapshotDependencyTests-2075072668 None] Created volume successfully. Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-16ce4f60-31c3-4866-b0cd-765f8b044adf-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-16ce4f60-31c3-4866-b0cd-765f8b044adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Deleting offline snapshot 16ce4f60-31c3-4866-b0cd-765f8b044adf of volume 432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] snapshot_file for this snap is: volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4b8cce-5eed-4659-873e-0e252aaf24ac]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:48 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:48 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:49 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 1073741824" returned: 0 in 1.131s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:49 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 Jul 09 02:58:49 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:49 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 0.984s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[05753072-3a7f-4de4-ac76-78bdbd9ddc51]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:49 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:49 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:50 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972da4d8-9e11-49cb-83b1-4aab00c71a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b5c526-640a-4a7d-adc8-5324bd01cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Volume volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 (fe0223fb-cbc6-4598-ab3c-6694e8e33786): created successfully Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b5c526-640a-4a7d-adc8-5324bd01cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (5f290e10-0d55-41e0-9693-419ee2dd07f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e83fbb62-a6da-4446-a450-05cb059f4ac9 tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:58:50 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 1.090s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:50 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:50 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-fe0223fb-cbc6-4598-ab3c-6694e8e33786-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "cinder-fe0223fb-cbc6-4598-ab3c-6694e8e33786-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-quobyte-fe0223fb-cbc6-4598-ab3c-6694e8e33786" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-fe0223fb-cbc6-4598-ab3c-6694e8e33786" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea3479-dbd8-4fe7-8a00-1ed9b052397f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:51 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 Jul 09 02:58:51 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:52 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 1.399s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:52 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf Jul 09 02:58:52 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:52 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786" returned: 0 in 1.243s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:52 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786 Jul 09 02:58:52 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:53 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a.16ce4f60-31c3-4866-b0cd-765f8b044adf" returned: 0 in 0.987s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:53 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-16ce4f60-31c3-4866-b0cd-765f8b044adf" released by "_delete_snapshot" :: held 4.636s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-fe0223fb-cbc6-4598-ab3c-6694e8e33786" returned: 0 in 0.989s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" released by "delete_snapshot" :: held 4.680s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-fe0223fb-cbc6-4598-ab3c-6694e8e33786" released by "delete_volume" :: held 2.310s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Created reservations ['1b8dc929-1cdc-4c8f-b888-d96be10c3ebc', '542a8654-7dc8-4438-a9e6-3ee20cf08a35', 'bd4aaab6-5dee-4678-91b8-3482e7cb2f59', 'c9f699f5-2978-48c6-824a-26982fa47394'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Created reservations ['fb3a831b-a17f-470f-baa8-778c3ee49feb', '91d4a4a7-e3ab-4a50-9032-20fcee79512f', '7f91cc80-ccc4-492b-91d1-4fc1c50037b1', 'af9a5614-6132-4a76-8968-c09a9fcd147e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Delete snapshot completed successfully. Jul 09 02:58:53 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-343b99fc-14b1-4c9f-b7af-ea53c55e9fbf tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-16ce4f60-31c3-4866-b0cd-765f8b044adf-delete_snapshot" released by "delete_snapshot" :: held 5.037s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:53 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6fab2f-7564-4dc6-bce0-15eefb4bf1e7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:54 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:54 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:54 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.078s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Deleted volume successfully. Jul 09 02:58:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29b6784c-a2ee-466d-98ff-afb36b258daf tempest-VolumesActionsTest-112188859 None] Lock "cinder-fe0223fb-cbc6-4598-ab3c-6694e8e33786-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:55 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 1.034s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:55 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a Jul 09 02:58:55 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (380bd1d8-870c-4890-be21-3a67f345b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cef45c-d2a6-437a-8c40-6e5d5a2c75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cef45c-d2a6-437a-8c40-6e5d5a2c75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156565596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5315ee2-e5c7-4d75-a062-d223db232ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:55Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5b8dd0-58ec-4696-8e3b-40b547cb5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5b8dd0-58ec-4696-8e3b-40b547cb5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a9335a-222c-4dc9-bd6a-52ce228fe627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a9335a-222c-4dc9-bd6a-52ce228fe627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5315ee2-e5c7-4d75-a062-d223db232ca7', 'volume_name': 'volume-d5315ee2-e5c7-4d75-a062-d223db232ca7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9882bcc0-03dc-48ce-9b90-2b89ff55efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9882bcc0-03dc-48ce-9b90-2b89ff55efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af5cbe0-1f45-4202-8158-533f2f6af936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Volume d5315ee2-e5c7-4d75-a062-d223db232ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5315ee2-e5c7-4d75-a062-d223db232ca7', 'volume_size': 1} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156565596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5315ee2-e5c7-4d75-a062-d223db232ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:58:55Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Creating volume d5315ee2-e5c7-4d75-a062-d223db232ca7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:58:55 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:55 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 1073741824 Jul 09 02:58:55 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:55 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" returned: 0 in 0.772s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a" released by "delete_volume" :: held 1.903s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Created reservations ['820d7534-a506-42d6-a077-29c971b54b20', '92dbeb5c-6243-48a0-8f68-4a109499cf07', '1e1a2203-81f9-4b0d-8d72-db578fe11d62', '11a513c1-b1a7-4b3d-9880-b3a9781cefc1'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:56 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:56 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-21325e39-1f6e-4937-b934-f229704a34c8-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-21325e39-1f6e-4937-b934-f229704a34c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea2128-ae2d-4daa-8946-79db5b83ec72]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:56 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 1073741824" returned: 0 in 1.346s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:56 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 Jul 09 02:58:56 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:56 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 Jul 09 02:58:56 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:57 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.034s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Deleted volume successfully. Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e0181467-480a-4b03-bc11-f3042c4a5912 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-432e0a7c-1ae7-4e2f-b252-5b7fa0b6335a-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:57 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7" returned: 0 in 0.949s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af5cbe0-1f45-4202-8158-533f2f6af936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5315ee2-e5c7-4d75-a062-d223db232ca7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:57 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5ad6f4-d393-4fe0-b330-efb3ffb79852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8" returned: 0 in 1.192s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:57 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Volume volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 (d5315ee2-e5c7-4d75-a062-d223db232ca7): created successfully Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5ad6f4-d393-4fe0-b330-efb3ffb79852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:58:57 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8 Jul 09 02:58:57 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (380bd1d8-870c-4890-be21-3a67f345b788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:58:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-903cf7da-d3f5-4c0b-af85-0ee9830a101a tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:58:58 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-21325e39-1f6e-4937-b934-f229704a34c8" returned: 0 in 0.762s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-quobyte-21325e39-1f6e-4937-b934-f229704a34c8" released by "delete_volume" :: held 2.036s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Created reservations ['3faba599-e6c9-459c-a73a-ccbcccccf0da', 'de78a964-13ca-4b99-94fd-9e8440fb6040', '88c32fb5-2ef5-4735-8805-ca14abf9e8ce', '4de5132f-56ad-40ba-abd8-77b5d6d84570'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-d5315ee2-e5c7-4d75-a062-d223db232ca7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "cinder-d5315ee2-e5c7-4d75-a062-d223db232ca7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:58 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:58:58 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Acquiring lock "cinder-quobyte-d5315ee2-e5c7-4d75-a062-d223db232ca7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-d5315ee2-e5c7-4d75-a062-d223db232ca7" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a8d4ef-9f25-43aa-81a0-21c67ff0af2b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:58:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:58:59 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 Jul 09 02:58:59 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:58:59 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 09 02:58:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.958s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:58:59 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:58:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Deleted volume successfully. Jul 09 02:58:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-73752d55-b1ad-4697-83a8-b455acd882e2 tempest-SnapshotDependencyTests-2075072668 None] Lock "cinder-21325e39-1f6e-4937-b934-f229704a34c8-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:00 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7" returned: 0 in 1.151s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:00 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7 Jul 09 02:59:00 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:00 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d5315ee2-e5c7-4d75-a062-d223db232ca7" returned: 0 in 0.782s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "cinder-quobyte-d5315ee2-e5c7-4d75-a062-d223db232ca7" released by "delete_volume" :: held 2.017s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Created reservations ['3b21a437-ae4e-4904-8d48-6bda48f513fb', 'a37cc733-25f5-4474-867e-452b8e3d0353', 'c9480131-1a6c-4ebc-a431-f42bea0c4219', '296ba6e7-cfc3-4e99-9ddb-301aaab12ae1'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:01 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:01 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:01 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Deleted volume successfully. Jul 09 02:59:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1b29ba8b-2d13-4629-ac59-7fdb96d211bc tempest-VolumesActionsTest-112188859 None] Lock "cinder-d5315ee2-e5c7-4d75-a062-d223db232ca7-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (bfa5c1e7-cb52-48d3-8482-4c74e02f90af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ebc7fb-7732-4c28-82c8-d8ec90cb0afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ebc7fb-7732-4c28-82c8-d8ec90cb0afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1376028593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a294f5c-7920-4c27-ac4f-2f0d8cff6972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:03Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b19dc-4919-4afc-a272-155e8831ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b19dc-4919-4afc-a272-155e8831ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b7af74-f14a-457e-9127-b3e5c18d2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b7af74-f14a-457e-9127-b3e5c18d2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a294f5c-7920-4c27-ac4f-2f0d8cff6972', 'volume_name': 'volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517efa7b-7fc1-4e3c-9fa8-4bbd6560e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517efa7b-7fc1-4e3c-9fa8-4bbd6560e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5b5ccd-40c7-48e9-9b88-0e524a815c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:02 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Volume 8a294f5c-7920-4c27-ac4f-2f0d8cff6972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972', 'volume_size': 1} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1376028593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a294f5c-7920-4c27-ac4f-2f0d8cff6972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1bc6aa66164fb8a939e3182dab4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:03Z,use_quota=True,user_id='8204463fc1c14f59923744cd9ec09917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Creating volume 8a294f5c-7920-4c27-ac4f-2f0d8cff6972 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:02 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:02 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 1073741824 Jul 09 02:59:02 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:04 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 1073741824" returned: 0 in 1.256s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:04 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 Jul 09 02:59:04 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:04 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5b5ccd-40c7-48e9-9b88-0e524a815c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeb0989-f87d-4262-a013-09a2ea1b52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:04 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Volume volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 (8a294f5c-7920-4c27-ac4f-2f0d8cff6972): created successfully Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeb0989-f87d-4262-a013-09a2ea1b52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Flow 'volume_create_manager' (bfa5c1e7-cb52-48d3-8482-4c74e02f90af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5e1f8b1b-c267-42ad-a86f-8d57f43211b9 tempest-VolumesActionsTest-191724911 None] Created volume successfully. Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-8a294f5c-7920-4c27-ac4f-2f0d8cff6972-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "cinder-8a294f5c-7920-4c27-ac4f-2f0d8cff6972-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Acquiring lock "cinder-quobyte-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "cinder-quobyte-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c6f0a-fe11-4fa5-aa45-a0ae11cdda21]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:07 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 Jul 09 02:59:07 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" returned: 0 in 1.156s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:08 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:08 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972 Jul 09 02:59:08 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Flow 'volume_create_manager' (8794b833-cdf2-44b2-93b9-9ac277757bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b7b18a-1b31-4dc5-8adb-9ece0a148b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b7b18a-1b31-4dc5-8adb-9ece0a148b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1777522889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46073eb0-6f6c-453e-a7f8-58dab75dd01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc28e76d0a94f9892973d4b06d83685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:09Z,use_quota=True,user_id='0021f435246246f9bbf5f82c3d55b7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec5832-01f6-4498-8506-e0d6bb755db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec5832-01f6-4498-8506-e0d6bb755db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda98c33-96d7-400b-b635-9b843d106b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda98c33-96d7-400b-b635-9b843d106b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46073eb0-6f6c-453e-a7f8-58dab75dd01e', 'volume_name': 'volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04411401-3660-400b-8b9f-144d83bfd936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04411401-3660-400b-8b9f-144d83bfd936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53df76de-0395-47ed-a64e-cfcfd31aafe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:08 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume 46073eb0-6f6c-453e-a7f8-58dab75dd01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e', 'volume_size': 1} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1777522889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46073eb0-6f6c-453e-a7f8-58dab75dd01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc28e76d0a94f9892973d4b06d83685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:09Z,use_quota=True,user_id='0021f435246246f9bbf5f82c3d55b7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Creating volume 46073eb0-6f6c-453e-a7f8-58dab75dd01e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:08 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:08 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e 1073741824 Jul 09 02:59:08 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:09 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" returned: 0 in 1.430s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Flow 'volume_create_manager' (1d09f5cd-c2ad-4a3e-90de-0a3e1937508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a767ed5-c7ea-4700-ac48-d5ad72a7f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "cinder-quobyte-8a294f5c-7920-4c27-ac4f-2f0d8cff6972" released by "delete_volume" :: held 2.715s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a767ed5-c7ea-4700-ac48-d5ad72a7f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1093696153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0387ad18-4c61-4b1e-9bc7-599cb1ef9991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc28e76d0a94f9892973d4b06d83685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:09Z,use_quota=True,user_id='0021f435246246f9bbf5f82c3d55b7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db3107c-d4c1-465e-a1a9-ecd4355ad97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db3107c-d4c1-465e-a1a9-ecd4355ad97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33781d9-07bc-4268-98df-fffcd0e32a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33781d9-07bc-4268-98df-fffcd0e32a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0387ad18-4c61-4b1e-9bc7-599cb1ef9991', 'volume_name': 'volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedf5a95-4607-4280-ac1d-a3343d83d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedf5a95-4607-4280-ac1d-a3343d83d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a3b53d-f7d0-4a76-aa40-ecf94be16aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:09 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume 0387ad18-4c61-4b1e-9bc7-599cb1ef9991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991', 'volume_size': 1} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Created reservations ['57471324-f0a6-4f58-99e9-3b55d6304386', '4a879a5b-0887-482f-aa7a-b4549caf07cb', '2d7b80b3-9972-4d83-8066-860047896454', '9639d6de-406d-42ff-8d93-effd58edd3b7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:09 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:09 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:10 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e 1073741824" returned: 0 in 1.268s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:10 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e Jul 09 02:59:10 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:10 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.868s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:10 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Deleted volume successfully. Jul 09 02:59:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8698801d-7494-4673-a155-7579004dfd91 tempest-VolumesActionsTest-191724911 None] Lock "cinder-8a294f5c-7920-4c27-ac4f-2f0d8cff6972-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:11 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1093696153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0387ad18-4c61-4b1e-9bc7-599cb1ef9991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc28e76d0a94f9892973d4b06d83685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:09Z,use_quota=True,user_id='0021f435246246f9bbf5f82c3d55b7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Creating volume 0387ad18-4c61-4b1e-9bc7-599cb1ef9991 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:11 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53df76de-0395-47ed-a64e-cfcfd31aafe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:11 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 1073741824 Jul 09 02:59:11 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b415-d619-4355-aa2d-a1d0dd277338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e (46073eb0-6f6c-453e-a7f8-58dab75dd01e): created successfully Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b415-d619-4355-aa2d-a1d0dd277338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Flow 'volume_create_manager' (8794b833-cdf2-44b2-93b9-9ac277757bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-afbeb1d3-2ccf-4a64-937c-1a867954a075 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Created volume successfully. Jul 09 02:59:12 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 1073741824" returned: 0 in 1.061s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:12 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 Jul 09 02:59:12 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:12 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a3b53d-f7d0-4a76-aa40-ecf94be16aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a742494-2046-4fbc-82f5-5c257fcc605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Volume volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 (0387ad18-4c61-4b1e-9bc7-599cb1ef9991): created successfully Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a742494-2046-4fbc-82f5-5c257fcc605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Flow 'volume_create_manager' (1d09f5cd-c2ad-4a3e-90de-0a3e1937508a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4ba49f0c-f7da-4650-9cb2-91649d360aba tempest-TestServerVolumeAttachmentScenario-1093201757 None] Created volume successfully. Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (f23ea178-bbaf-42bd-b935-214669314057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7dd743-3459-43c4-a97d-6e2c9a866e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7dd743-3459-43c4-a97d-6e2c9a866e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-809447888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdf199d-9286-44f8-935b-e0c4dc1dd1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:18Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596f3afe-7a4e-4cd7-a975-73d075420964),volume_type_id=596f3afe-7a4e-4cd7-a975-73d075420964)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a070773f-fa79-4673-869c-4f7aad83ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a070773f-fa79-4673-869c-4f7aad83ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189f458f-98fd-4e80-980e-d68d6c12b199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189f458f-98fd-4e80-980e-d68d6c12b199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fdf199d-9286-44f8-935b-e0c4dc1dd1ae', 'volume_name': 'volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edd8770-ab9a-45e9-a4d2-bc9bc6a0e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edd8770-ab9a-45e9-a4d2-bc9bc6a0e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a566d0b4-e6c4-47f9-bd8b-d585e4f25ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume 6fdf199d-9286-44f8-935b-e0c4dc1dd1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae', 'volume_size': 1} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-809447888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdf199d-9286-44f8-935b-e0c4dc1dd1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:18Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596f3afe-7a4e-4cd7-a975-73d075420964),volume_type_id=596f3afe-7a4e-4cd7-a975-73d075420964)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Creating volume 6fdf199d-9286-44f8-935b-e0c4dc1dd1ae {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:17 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:17 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae 1073741824 Jul 09 02:59:17 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (bab4d5aa-f44e-4207-aa5a-e31cfae9548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc53ea0-4776-4332-9d5b-3e40f97c483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc53ea0-4776-4332-9d5b-3e40f97c483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033466220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9accff4-b120-40d2-8259-bf7016d3e49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:18Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4339179-20fb-4c4e-b452-ebb468eee56a),volume_type_id=d4339179-20fb-4c4e-b452-ebb468eee56a)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6702450-fc38-44e2-8611-7c4186541b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6702450-fc38-44e2-8611-7c4186541b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63950f1-fc21-40cc-aae7-fb786195f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63950f1-fc21-40cc-aae7-fb786195f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9accff4-b120-40d2-8259-bf7016d3e49e', 'volume_name': 'volume-d9accff4-b120-40d2-8259-bf7016d3e49e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ee8e6-9d2c-4933-bec5-0200b45c9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ee8e6-9d2c-4933-bec5-0200b45c9482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f39e6-91c8-45c9-a857-fb567ed592e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume d9accff4-b120-40d2-8259-bf7016d3e49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9accff4-b120-40d2-8259-bf7016d3e49e', 'volume_size': 1} Jul 09 02:59:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:19 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae 1073741824" returned: 0 in 1.307s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:19 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae Jul 09 02:59:19 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (b675b715-9cf3-42bb-8d8a-903dd85f2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cb5666-6d63-4405-8336-7561a4b20515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cb5666-6d63-4405-8336-7561a4b20515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1419895441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbddc5b-47da-4a66-b160-915e715e6656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:19Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28121a22-1244-42d1-aaf7-aa729e637006),volume_type_id=28121a22-1244-42d1-aaf7-aa729e637006)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd16d72-34a2-4018-82d6-2de42aa99b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd16d72-34a2-4018-82d6-2de42aa99b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afd9e3-21b6-4dab-a660-335567b34e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:19 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afd9e3-21b6-4dab-a660-335567b34e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6dbddc5b-47da-4a66-b160-915e715e6656', 'volume_name': 'volume-6dbddc5b-47da-4a66-b160-915e715e6656', 'volume_size': 1, 'image_id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214467153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '389a84806aae491485a748331ad6d866', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'created_at': datetime.datetime(2026, 7, 9, 0, 59, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 59, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc12f13a-1701-4cde-9e00-60474ef6620c/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bf244-ffa4-461a-a599-57a20f947eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bf244-ffa4-461a-a599-57a20f947eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072eabfb-69e8-4cfa-af2e-e8f3bb72838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume 6dbddc5b-47da-4a66-b160-915e715e6656: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6dbddc5b-47da-4a66-b160-915e715e6656', 'volume_size': 1, 'image_id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214467153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '389a84806aae491485a748331ad6d866', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'created_at': datetime.datetime(2026, 7, 9, 0, 59, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 59, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc12f13a-1701-4cde-9e00-60474ef6620c/file', 'properties': {}}, 'image_service': } Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Trying to clone 6dbddc5b-47da-4a66-b160-915e715e6656 from image dc12f13a-1701-4cde-9e00-60474ef6620c at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 02:59:20 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" returned: 0 in 1.046s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033466220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9accff4-b120-40d2-8259-bf7016d3e49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:18Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4339179-20fb-4c4e-b452-ebb468eee56a),volume_type_id=d4339179-20fb-4c4e-b452-ebb468eee56a)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Creating volume d9accff4-b120-40d2-8259-bf7016d3e49e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:20 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:20 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e 1073741824 Jul 09 02:59:20 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a566d0b4-e6c4-47f9-bd8b-d585e4f25ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a389abb-1a13-46b5-b737-ecc22233bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae (6fdf199d-9286-44f8-935b-e0c4dc1dd1ae): created successfully Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a389abb-1a13-46b5-b737-ecc22233bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (f23ea178-bbaf-42bd-b935-214669314057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e725194a-3123-448e-bc4f-6988beef9be7 tempest-TestInstancesWithCinderVolumes-52577665 None] Created volume successfully. Jul 09 02:59:21 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e 1073741824" returned: 0 in 1.354s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:21 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e Jul 09 02:59:21 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:22 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e" returned: 0 in 0.878s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f39e6-91c8-45c9-a857-fb567ed592e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9accff4-b120-40d2-8259-bf7016d3e49e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4240ab4-dbcd-4fda-8e3f-8a5cfd7986fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:22 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume volume-d9accff4-b120-40d2-8259-bf7016d3e49e (d9accff4-b120-40d2-8259-bf7016d3e49e): created successfully Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4240ab4-dbcd-4fda-8e3f-8a5cfd7986fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (bab4d5aa-f44e-4207-aa5a-e31cfae9548e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f87a1ff3-d657-411d-b2d4-5c91aaf3c557 tempest-TestInstancesWithCinderVolumes-52577665 None] Created volume successfully. Jul 09 02:59:24 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD, size 20.69 MB, duration 4.06 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 02:59:24 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Image download 20.69 MB at 5.10 MB/s Jul 09 02:59:24 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3b8037-090f-47ce-a6eb-60706915e9cd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:24 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD Jul 09 02:59:24 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:25 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:25 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Temporary image dc12f13a-1701-4cde-9e00-60474ef6620c is fetched for user 2300babb4e84446f9f69f38492dddc94. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 02:59:25 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2115c6-eaf3-4f9e-b7c2-ad8bdb47df77]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:25 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD Jul 09 02:59:25 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:26 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD" returned: 0 in 0.930s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1419895441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbddc5b-47da-4a66-b160-915e715e6656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389a84806aae491485a748331ad6d866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:19Z,use_quota=True,user_id='2300babb4e84446f9f69f38492dddc94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28121a22-1244-42d1-aaf7-aa729e637006),volume_type_id=28121a22-1244-42d1-aaf7-aa729e637006)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Creating volume 6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:26 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:26 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1073741824 Jul 09 02:59:26 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:27 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1073741824" returned: 0 in 1.031s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:27 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:27 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:27 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:28 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:28 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 0.695s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Attempting download of dc12f13a-1701-4cde-9e00-60474ef6620c ((None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}])) to volume 6dbddc5b-47da-4a66-b160-915e715e6656. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684a40f-6676-4189-aa7d-871b3f77a86f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:28 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3 Jul 09 02:59:28 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:28 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.774s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 02:59:28 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3" returned: 0 in 0.812s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:29 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3 Jul 09 02:59:29 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (e0a47b9d-8fb0-4a0a-a012-bdba7dd25634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0522d017-08fb-4afd-8538-a78b0b672dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0522d017-08fb-4afd-8538-a78b0b672dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-532257741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc95224-6946-4a37-ab6b-bc1c3fd754b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:29Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae323d4-b668-451d-82d5-6d23960c1314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae323d4-b668-451d-82d5-6d23960c1314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab95320-f663-4902-b139-a22ab8b38584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab95320-f663-4902-b139-a22ab8b38584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc95224-6946-4a37-ab6b-bc1c3fd754b6', 'volume_name': 'volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d1b335-fe1d-48dd-9142-fa398a0b493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d1b335-fe1d-48dd-9142-fa398a0b493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fbe39f-7dd0-412f-abc8-a4db837b9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Volume 6cc95224-6946-4a37-ab6b-bc1c3fd754b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6', 'volume_size': 1} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-532257741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc95224-6946-4a37-ab6b-bc1c3fd754b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:29Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Creating volume 6cc95224-6946-4a37-ab6b-bc1c3fd754b6 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:29 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:29 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 1073741824 Jul 09 02:59:29 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:29 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3" returned: 1 in 0.767s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc12f13a-1701-4cde-9e00-60474ef6620c_huqn4ng3' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[60255a07-b561-4be3-941a-18ca2c6178f3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:29 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD Jul 09 02:59:29 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:30 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 1073741824" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:30 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 Jul 09 02:59:30 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:30 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:30 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] dc12f13a-1701-4cde-9e00-60474ef6620c was qcow2, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 02:59:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:30 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:30 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:31 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" returned: 0 in 0.867s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fbe39f-7dd0-412f-abc8-a4db837b9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8558d50f-0079-4b66-a447-2067b68386fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Volume volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 (6cc95224-6946-4a37-ab6b-bc1c3fd754b6): created successfully Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8558d50f-0079-4b66-a447-2067b68386fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (e0a47b9d-8fb0-4a0a-a012-bdba7dd25634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8609fda2-d666-4ecc-9fc0-5845f0521ce6 tempest-VolumesListAdminTestJSON-2120130235 None] Created volume successfully. Jul 09 02:59:32 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 2.317s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:32 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc12f13a-1701-4cde-9e00-60474ef6620c_382g2i4zdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 02:59:32 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Converted 112.00 MB image at 48.32 MB/s Jul 09 02:59:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:32 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1G Jul 09 02:59:32 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (2e4d4217-859d-4d61-8402-fef1c904fda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bfe17c-66ec-4b9a-9146-1e3122e02e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bfe17c-66ec-4b9a-9146-1e3122e02e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-803467966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e070ac-b95c-47f7-a0e2-622fc20abf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:33Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6419da-e847-4be3-bf50-384a47ec378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6419da-e847-4be3-bf50-384a47ec378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942945a-ee0d-4144-98e4-ff3e55f83b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942945a-ee0d-4144-98e4-ff3e55f83b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e070ac-b95c-47f7-a0e2-622fc20abf42', 'volume_name': 'volume-60e070ac-b95c-47f7-a0e2-622fc20abf42', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79c13d-0cdd-4994-82e5-e35819c326d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79c13d-0cdd-4994-82e5-e35819c326d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489328e9-8df5-4f2f-8a92-bd72726d19d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:33 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Volume 60e070ac-b95c-47f7-a0e2-622fc20abf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e070ac-b95c-47f7-a0e2-622fc20abf42', 'volume_size': 1} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-803467966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e070ac-b95c-47f7-a0e2-622fc20abf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:33Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Creating volume 60e070ac-b95c-47f7-a0e2-622fc20abf42 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:33 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:33 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 1073741824 Jul 09 02:59:33 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:33 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 1G" returned: 0 in 0.770s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[44123323-e703-435e-8992-12b45a94af9a]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:33 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:33 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:34 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 1073741824" returned: 0 in 1.035s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:34 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 Jul 09 02:59:34 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:34 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 0.892s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:34 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:34 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:35 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42" returned: 0 in 0.804s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489328e9-8df5-4f2f-8a92-bd72726d19d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e070ac-b95c-47f7-a0e2-622fc20abf42', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1041a1-d52e-427b-9ca6-e9d022844b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:35 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Volume volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 (60e070ac-b95c-47f7-a0e2-622fc20abf42): created successfully Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1041a1-d52e-427b-9ca6-e9d022844b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (2e4d4217-859d-4d61-8402-fef1c904fda6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-37c3c2c5-b840-468f-ae5e-0098b3263dd1 tempest-VolumesListAdminTestJSON-2120130235 None] Created volume successfully. Jul 09 02:59:35 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 1 in 0.828s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Downloaded image dc12f13a-1701-4cde-9e00-60474ef6620c ((None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}])) to volume 6dbddc5b-47da-4a66-b160-915e715e6656 successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Temporary image dc12f13a-1701-4cde-9e00-60474ef6620c for user 2300babb4e84446f9f69f38492dddc94 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Marking volume 6dbddc5b-47da-4a66-b160-915e715e6656 as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Copying metadata from image dc12f13a-1701-4cde-9e00-60474ef6620c to 6dbddc5b-47da-4a66-b160-915e715e6656. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Creating volume glance metadata for volume 6dbddc5b-47da-4a66-b160-915e715e6656 backed by image dc12f13a-1701-4cde-9e00-60474ef6620c with: {'image_id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'image_name': 'tempest-scenario-img--1214467153', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072eabfb-69e8-4cfa-af2e-e8f3bb72838c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbddc5b-47da-4a66-b160-915e715e6656', 'volume_size': 1, 'image_id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc12f13a-1701-4cde-9e00-60474ef6620c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214467153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '389a84806aae491485a748331ad6d866', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc12f13a-1701-4cde-9e00-60474ef6620c', 'created_at': datetime.datetime(2026, 7, 9, 0, 59, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 59, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc12f13a-1701-4cde-9e00-60474ef6620c/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e87094-1337-4275-99d8-a8f57a4f9b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:35 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Volume volume-6dbddc5b-47da-4a66-b160-915e715e6656 (6dbddc5b-47da-4a66-b160-915e715e6656): created successfully Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e87094-1337-4275-99d8-a8f57a4f9b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Flow 'volume_create_manager' (b675b715-9cf3-42bb-8d8a-903dd85f2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b921f9a2-81bb-4657-a50b-6e321bfe4196 tempest-TestInstancesWithCinderVolumes-52577665 None] Created volume successfully. Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (d10e6ee7-f02b-4362-bb19-0cea271d5a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b947dd0-315d-49fe-a030-efcac49dd711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b947dd0-315d-49fe-a030-efcac49dd711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881370602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dabba61-e465-4115-b57c-bc26ce8a107b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:37Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432eeaee-cdf2-4de0-ab85-c124e9540f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432eeaee-cdf2-4de0-ab85-c124e9540f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd3fb26-77b2-4de4-b9d0-51d04bb1436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd3fb26-77b2-4de4-b9d0-51d04bb1436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dabba61-e465-4115-b57c-bc26ce8a107b', 'volume_name': 'volume-5dabba61-e465-4115-b57c-bc26ce8a107b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5092984-dcc1-4fde-804d-6c65322dfc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5092984-dcc1-4fde-804d-6c65322dfc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3812f266-a9b5-48aa-b912-2953321016c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Volume 5dabba61-e465-4115-b57c-bc26ce8a107b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dabba61-e465-4115-b57c-bc26ce8a107b', 'volume_size': 1} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881370602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dabba61-e465-4115-b57c-bc26ce8a107b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510f5726a4df4beba76dc4812119ac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:37Z,use_quota=True,user_id='ebda7dbe10374319ae406747120d017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Creating volume 5dabba61-e465-4115-b57c-bc26ce8a107b {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:37 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:37 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b 1073741824 Jul 09 02:59:37 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:38 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b 1073741824" returned: 0 in 1.161s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:38 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b Jul 09 02:59:38 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:38 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3812f266-a9b5-48aa-b912-2953321016c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dabba61-e465-4115-b57c-bc26ce8a107b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a08716-8911-47a4-899b-12e9464abadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Volume volume-5dabba61-e465-4115-b57c-bc26ce8a107b (5dabba61-e465-4115-b57c-bc26ce8a107b): created successfully Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a08716-8911-47a4-899b-12e9464abadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Flow 'volume_create_manager' (d10e6ee7-f02b-4362-bb19-0cea271d5a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0b4cc86f-d302-4970-a1f3-9c0f7048c460 tempest-VolumesListAdminTestJSON-2120130235 None] Created volume successfully. Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Flow 'volume_create_manager' (ee693c7f-d6be-407c-b457-d3d8d3dd2450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90800402-22fa-4b80-b718-9617af6d222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90800402-22fa-4b80-b718-9617af6d222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce37f850d2c423fac1e5a4f40f7619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:40Z,use_quota=True,user_id='f29d4072846c4069a6442603a6736771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d2e232-d823-4cdd-9f8d-a6e58c6e28b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d2e232-d823-4cdd-9f8d-a6e58c6e28b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fd0e23-67b4-490d-81f0-bd53acb396ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fd0e23-67b4-490d-81f0-bd53acb396ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c', 'volume_name': 'volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebd9e1d-8490-48aa-99a0-4b8db4659d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebd9e1d-8490-48aa-99a0-4b8db4659d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad27017c-84ae-42d8-9d98-f213166174fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:39 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Volume 3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c', 'volume_size': 1} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce37f850d2c423fac1e5a4f40f7619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:40Z,use_quota=True,user_id='f29d4072846c4069a6442603a6736771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Creating volume 3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:39 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:39 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c 1073741824 Jul 09 02:59:39 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:40 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c 1073741824" returned: 0 in 0.862s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:40 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c Jul 09 02:59:40 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:41 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" returned: 0 in 0.643s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad27017c-84ae-42d8-9d98-f213166174fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d573d0-0c7c-4355-8b07-5d9192ba9b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Volume volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c (3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c): created successfully Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d573d0-0c7c-4355-8b07-5d9192ba9b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Flow 'volume_create_manager' (ee693c7f-d6be-407c-b457-d3d8d3dd2450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fb6b76e1-077c-485c-865b-e8071aff78c0 tempest-VolumesListAdminTestJSON-779755966 None] Created volume successfully. Jul 09 02:59:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Acquiring lock "cinder-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "cinder-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Acquiring lock "cinder-quobyte-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "cinder-quobyte-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8ae01-da76-4cc0-9893-1f6a826d5bad]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-5dabba61-e465-4115-b57c-bc26ce8a107b-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-5dabba61-e465-4115-b57c-bc26ce8a107b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-quobyte-5dabba61-e465-4115-b57c-bc26ce8a107b" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-5dabba61-e465-4115-b57c-bc26ce8a107b" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:42 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c Jul 09 02:59:42 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[801205d6-ceee-4f74-a45b-ecc998982a87]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:42 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b Jul 09 02:59:42 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:43 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" returned: 0 in 1.333s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:43 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c Jul 09 02:59:43 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:43 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b" returned: 0 in 1.228s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:43 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b Jul 09 02:59:43 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c23a2d0-2d53-4855-9d6e-5144809e3516]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:44 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" returned: 0 in 1.078s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "cinder-quobyte-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c" released by "delete_volume" :: held 2.474s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Created reservations ['45acf94a-cc3f-463f-a3d0-35c7fb0c364a', '40ddc413-7df7-476c-a2a0-f6241a155133', '5300551f-68de-4e65-8b08-440fa35adc61', '6ecf6e9e-6ccd-4a53-aa5e-dd24c07b7635'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:44 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:44 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:44 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5dabba61-e465-4115-b57c-bc26ce8a107b" returned: 0 in 1.217s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-5dabba61-e465-4115-b57c-bc26ce8a107b" released by "delete_volume" :: held 2.536s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Created reservations ['4f027b48-5dc1-432b-adb7-6f21ff701bdb', '35f18139-eeca-47b0-a7eb-152a3b0e62c2', 'f46f576f-79cc-4e29-94aa-eca70229c99f', '3846969f-af33-4a54-807c-48917884c8ad'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:44 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:44 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:45 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:45 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-60e070ac-b95c-47f7-a0e2-622fc20abf42-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-60e070ac-b95c-47f7-a0e2-622fc20abf42-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-quobyte-60e070ac-b95c-47f7-a0e2-622fc20abf42" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:45 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-60e070ac-b95c-47f7-a0e2-622fc20abf42" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 1.468s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c3dad4-b3db-4a3a-b582-86285900c3c9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:45 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.143s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:45 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:45 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Deleted volume successfully. Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.034s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Deleted volume successfully. Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-50e73204-623d-461c-99ba-102322d1fe17 tempest-VolumesListAdminTestJSON-779755966 None] Lock "cinder-3255cd9a-8b1e-48d4-ba7b-9d5315a37d8c-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-843ab4d8-6244-449a-92de-a83228d5adeb tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-5dabba61-e465-4115-b57c-bc26ce8a107b-delete_volume" released by "delete_volume" :: held 3.900s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:46 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 02:59:46 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:46 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 Jul 09 02:59:46 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:46 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 1 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.339s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-6dbddc5b-47da-4a66-b160-915e715e6656', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af5e0ae7-f183-4147-bb16-e62275420de2', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 02:59:46 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42" returned: 0 in 0.847s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:46 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42 Jul 09 02:59:46 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-7fac13c6-8803-498c-a6b5-1907d59c8fca req-d01c91ac-72a6-47dc-8e9f-4de43f2bf031 tempest-TestInstancesWithCinderVolumes-52577665 None] attachment_update completed successfully. Jul 09 02:59:47 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-60e070ac-b95c-47f7-a0e2-622fc20abf42" returned: 0 in 0.658s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-60e070ac-b95c-47f7-a0e2-622fc20abf42" released by "delete_volume" :: held 1.574s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Created reservations ['86676ef1-3fda-468f-aac3-e48d61a0e9dd', 'ea4197ef-ec07-4a14-8a6b-ff745334cf02', '7894a7d4-5ffb-42b6-9cc0-507c9fb97a5e', '87f95204-788f-485d-a350-1ef3cb56e1ba'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:47 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:47 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-6cc95224-6946-4a37-ab6b-bc1c3fd754b6-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-6cc95224-6946-4a37-ab6b-bc1c3fd754b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "cinder-quobyte-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 02:59:48 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.672s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Deleted volume successfully. Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=123,cinder:SELECT=84,cinder:INSERT=30,cinder:DELETE=13 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07497b-dada-450e-a9a9-8f756926585a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-36803568-e93e-4e58-9e4c-40c00ccd31be tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-60e070ac-b95c-47f7-a0e2-622fc20abf42-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:48 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 Jul 09 02:59:48 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:49 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" returned: 0 in 0.773s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:49 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6 Jul 09 02:59:49 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:49 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-quobyte-6cc95224-6946-4a37-ab6b-bc1c3fd754b6" released by "delete_volume" :: held 1.470s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:DELETE=8,cinder:SELECT=79,cinder:UPDATE=97,cinder:INSERT=27 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Created reservations ['5ecb5645-84fd-418c-a0c3-be8b16c8547e', '76ec7094-73cd-48d6-9ad3-43de4d2a5a8a', '010714bc-83c0-43fd-a090-75814e5c0c03', '0f88f475-ac9f-499a-86bb-ddda02fd5a23'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:49 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 02:59:49 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:50 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.887s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:50 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 02:59:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Deleted volume successfully. Jul 09 02:59:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6a49cb20-e2bc-41a3-b45e-71ac012f8a48 tempest-VolumesListAdminTestJSON-2120130235 None] Lock "cinder-6cc95224-6946-4a37-ab6b-bc1c3fd754b6-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Flow 'volume_create_manager' (48b7ce45-3397-4f41-9d00-c518070b3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2b0d9-b8a9-4015-9e65-95076ee8c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2b0d9-b8a9-4015-9e65-95076ee8c23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-612749289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd77c05-c950-4426-96bc-704a17020c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f32d0eb6ae74af8a00c450bf8cf20e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:56Z,use_quota=True,user_id='58870bb55fcf403183089243e3d6aef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efa5c6-4320-407d-9d99-632348ff53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efa5c6-4320-407d-9d99-632348ff53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f88a099-1c42-4300-b336-ce0b8d17ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:55 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f88a099-1c42-4300-b336-ce0b8d17ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1bd77c05-c950-4426-96bc-704a17020c5d', 'volume_name': 'volume-1bd77c05-c950-4426-96bc-704a17020c5d', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e463839-26eb-4db4-8527-a5a03177ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e463839-26eb-4db4-8527-a5a03177ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9d179-18bf-4df8-8c32-7984cb259429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 02:59:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Volume 1bd77c05-c950-4426-96bc-704a17020c5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1bd77c05-c950-4426-96bc-704a17020c5d', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Trying to clone 1bd77c05-c950-4426-96bc-704a17020c5d from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 02:59:56 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Image download 20.69 MB at 20.69 MB/s Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934a0bf-0881-4858-8f7d-6484054bf490]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:57 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD Jul 09 02:59:57 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:58 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD" returned: 0 in 1.192s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:58 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 is fetched for user 58870bb55fcf403183089243e3d6aef3. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 02:59:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d0b6c-e329-4a2e-9ff7-aac99ecb98f0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 02:59:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:58 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD Jul 09 02:59:58 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 02:59:59 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T00:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-612749289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd77c05-c950-4426-96bc-704a17020c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f32d0eb6ae74af8a00c450bf8cf20e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T00:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T00:59:56Z,use_quota=True,user_id='58870bb55fcf403183089243e3d6aef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Creating volume 1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 02:59:59 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 02:59:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 02:59:59 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1073741824 Jul 09 02:59:59 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:00 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1073741824" returned: 0 in 1.255s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:00 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:00 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:01 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 0 in 0.750s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[913954aa-661f-4aaa-8ced-794d8ac0e3cd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Attempting download of db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 1bd77c05-c950-4426-96bc-704a17020c5d. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a72718-863f-4fee-b3fb-a0caf70d5606]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:01 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e Jul 09 03:00:01 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:01 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna Jul 09 03:00:01 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:02 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:02 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna" returned: 0 in 0.991s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e" returned: 0 in 1.087s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.124s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b46abc97-7447-46f9-bce6-3980151555b0', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:00:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-f27f2197-0bc6-4481-8519-965d186bdd4e req-98a9e307-0f2d-48dc-abc6-9931f470c91d tempest-TestServerVolumeAttachmentScenario-1093201757 None] attachment_update completed successfully. Jul 09 03:00:02 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna Jul 09 03:00:02 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:03 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna" returned: 1 in 0.816s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_fevrxjna' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3792f5c8-b750-4f8c-bdda-9662e53f9d2c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:03 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD Jul 09 03:00:03 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:03 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] db9c7883-aaf0-4c13-905a-75c00f73e5a1 was qcow2, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:00:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:03 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:03 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:05 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 0 in 1.921s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:05 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_m0qq4u0hdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:00:05 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Converted 112.00 MB image at 58.27 MB/s Jul 09 03:00:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:05 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1G Jul 09 03:00:05 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:06 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d 1G" returned: 0 in 0.710s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8496334-df1e-4881-9e8c-3a706a2df153]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:06 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:06 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:07 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 0 in 0.787s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:07 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:07 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:08 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 1 in 1.056s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Downloaded image db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume 1bd77c05-c950-4426-96bc-704a17020c5d successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 for user 58870bb55fcf403183089243e3d6aef3 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Marking volume 1bd77c05-c950-4426-96bc-704a17020c5d as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Copying metadata from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 to 1bd77c05-c950-4426-96bc-704a17020c5d. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Creating volume glance metadata for volume 1bd77c05-c950-4426-96bc-704a17020c5d backed by image db9c7883-aaf0-4c13-905a-75c00f73e5a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9d179-18bf-4df8-8c32-7984cb259429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd77c05-c950-4426-96bc-704a17020c5d', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3309367f-97fc-4da9-9431-608aa630c81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:08 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Volume volume-1bd77c05-c950-4426-96bc-704a17020c5d (1bd77c05-c950-4426-96bc-704a17020c5d): created successfully Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3309367f-97fc-4da9-9431-608aa630c81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Flow 'volume_create_manager' (48b7ce45-3397-4f41-9d00-c518070b3759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ab6e0fab-23b0-4c6a-b08c-48ac8766da39 tempest-VolumesImageMetadata-212535861 None] Created volume successfully. Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Acquiring lock "cinder-1bd77c05-c950-4426-96bc-704a17020c5d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "cinder-1bd77c05-c950-4426-96bc-704a17020c5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Acquiring lock "cinder-quobyte-1bd77c05-c950-4426-96bc-704a17020c5d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "cinder-quobyte-1bd77c05-c950-4426-96bc-704a17020c5d" acquired by "delete_volume" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b012af7-fe86-45a2-84a7-1caa687ac8db]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:10 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:10 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:10 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 0 in 0.725s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:10 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:10 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:11 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 1 in 0.738s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:00:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:11 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d Jul 09 03:00:11 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117c969-f113-420a-ba99-6d72f5be0087]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:12 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd77c05-c950-4426-96bc-704a17020c5d" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:12 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 Jul 09 03:00:12 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "cinder-quobyte-1bd77c05-c950-4426-96bc-704a17020c5d" released by "delete_volume" :: held 2.240s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Created reservations ['01560a18-6222-47d3-a9e0-0b2efe32b461', 'ecb64f8a-3203-404e-a53d-0e75efa06d4b', 'dd03f8fe-a73a-4b1d-a78f-9c3454374cba', 'e24eceb7-0fef-4940-8f04-3cb7476929bf'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:12 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:12 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:13 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" returned: 0 in 0.810s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '711a518e-ed40-4148-a872-965e26ff6e86', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:00:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-6951ef1a-a41b-4bf5-ac3f-f77a8a0a3115 req-b0e5f768-8fbb-4d98-9b4a-2ebdc2e28b94 tempest-TestServerVolumeAttachmentScenario-1093201757 None] attachment_update completed successfully. Jul 09 03:00:13 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.652s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Deleted volume successfully. Jul 09 03:00:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8cf377ee-a057-4329-b793-1c3e66bbef7e tempest-VolumesImageMetadata-212535861 None] Lock "cinder-1bd77c05-c950-4426-96bc-704a17020c5d-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Flow 'volume_create_manager' (ffe51a77-6ca9-4037-b217-e418133febda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e955349-44d5-4914-b130-980b67a62aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e955349-44d5-4914-b130-980b67a62aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-890792578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf96fc3-0100-4b01-be7d-c3db8bbb01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260d8fbcd0494c35b818585e7cdfae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:18Z,use_quota=True,user_id='4f2254f4cc5e434497676648c223e6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b8e66-9e6a-4ccb-b0b5-a19893f38dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b8e66-9e6a-4ccb-b0b5-a19893f38dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fc5c80-80d4-4079-9010-c387b658d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fc5c80-80d4-4079-9010-c387b658d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf96fc3-0100-4b01-be7d-c3db8bbb01aa', 'volume_name': 'volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cab473e-61da-4d22-a975-39d49699769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cab473e-61da-4d22-a975-39d49699769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588ccd66-5f98-4058-b18d-dd77b7f648af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Volume 2cf96fc3-0100-4b01-be7d-c3db8bbb01aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa', 'volume_size': 1} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-890792578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf96fc3-0100-4b01-be7d-c3db8bbb01aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260d8fbcd0494c35b818585e7cdfae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:18Z,use_quota=True,user_id='4f2254f4cc5e434497676648c223e6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Creating volume 2cf96fc3-0100-4b01-be7d-c3db8bbb01aa {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:00:17 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:00:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:17 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa 1073741824 Jul 09 03:00:17 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:18 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa 1073741824" returned: 0 in 0.871s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:18 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa Jul 09 03:00:18 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-745054d2-df9c-41b8-9c13-1386b92d79de req-a52a2e9e-26e5-49d2-9006-2bcbec9c1dbb tempest-TestServerVolumeAttachmentScenario-1093201757 None] Terminate volume connection completed successfully. Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-745054d2-df9c-41b8-9c13-1386b92d79de req-a52a2e9e-26e5-49d2-9006-2bcbec9c1dbb tempest-TestServerVolumeAttachmentScenario-1093201757 None] Deleting attachment 711a518e-ed40-4148-a872-965e26ff6e86. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:00:19 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" returned: 0 in 0.686s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588ccd66-5f98-4058-b18d-dd77b7f648af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d112707a-21e9-4731-af06-c4c9af7050c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:19 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Volume volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa (2cf96fc3-0100-4b01-be7d-c3db8bbb01aa): created successfully Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d112707a-21e9-4731-af06-c4c9af7050c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Flow 'volume_create_manager' (ffe51a77-6ca9-4037-b217-e418133febda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-417463cc-dbfb-46ae-baec-2601f6efc269 tempest-VolumesTransfersTest-281623643 None] Created volume successfully. Jul 09 03:00:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c1010e18-2ece-4dc4-97c4-8f1be4aa0a1b tempest-VolumesTransfersTest-738373957 None] Transfer volume completed successfully. Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "cinder-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "cinder-quobyte-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-quobyte-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bab1d4-cc3c-4852-8cad-f66e7d2f854d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:21 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa Jul 09 03:00:21 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:22 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" returned: 0 in 0.776s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:22 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa Jul 09 03:00:22 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-0a05e834-670d-49b3-837d-146904b93b39 req-6ac3068a-5d2b-49f0-b6d5-9d350c649efd tempest-TestServerVolumeAttachmentScenario-1093201757 None] Terminate volume connection completed successfully. Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-0a05e834-670d-49b3-837d-146904b93b39 req-6ac3068a-5d2b-49f0-b6d5-9d350c649efd tempest-TestServerVolumeAttachmentScenario-1093201757 None] Deleting attachment b46abc97-7447-46f9-bce6-3980151555b0. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:00:22 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" returned: 0 in 0.642s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-quobyte-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa" released by "delete_volume" :: held 1.463s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Created reservations ['e77de3d2-5d2b-4f69-92af-fad15977550d', '7a589ee6-99aa-419b-a71a-9eed6f60a957', '8c8e8009-c634-4426-9e3e-037eeb76b193', '3e1ede70-0221-473f-93fa-de4a524dd9ee'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:22 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:22 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:23 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Deleted volume successfully. Jul 09 03:00:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a1112324-141f-475c-9947-f987e648957d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-2cf96fc3-0100-4b01-be7d-c3db8bbb01aa-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:23 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Flow 'volume_create_manager' (d312a766-f6ee-408f-9f2f-ec4994583dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e94d3-cdab-4483-8cdc-c4ae8b9ec3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e94d3-cdab-4483-8cdc-c4ae8b9ec3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670527641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af0fa1-d9b1-4297-ba66-770bb18c6010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260d8fbcd0494c35b818585e7cdfae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:24Z,use_quota=True,user_id='4f2254f4cc5e434497676648c223e6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce4230c-abde-4f10-855c-1647fca74303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce4230c-abde-4f10-855c-1647fca74303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654dc17a-a2e3-475b-a488-f3e79b2a7238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654dc17a-a2e3-475b-a488-f3e79b2a7238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39af0fa1-d9b1-4297-ba66-770bb18c6010', 'volume_name': 'volume-39af0fa1-d9b1-4297-ba66-770bb18c6010', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66d3115-7f02-431f-9b46-01ae2d1e380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66d3115-7f02-431f-9b46-01ae2d1e380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5370b212-8fe1-46c6-bf7f-11543600e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Volume 39af0fa1-d9b1-4297-ba66-770bb18c6010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39af0fa1-d9b1-4297-ba66-770bb18c6010', 'volume_size': 1} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670527641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af0fa1-d9b1-4297-ba66-770bb18c6010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260d8fbcd0494c35b818585e7cdfae53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:24Z,use_quota=True,user_id='4f2254f4cc5e434497676648c223e6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Creating volume 39af0fa1-d9b1-4297-ba66-770bb18c6010 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:00:24 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:24 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 1073741824 Jul 09 03:00:24 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:25 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 1073741824" returned: 0 in 0.937s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:25 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 Jul 09 03:00:25 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:25 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.823s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5370b212-8fe1-46c6-bf7f-11543600e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39af0fa1-d9b1-4297-ba66-770bb18c6010', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83864fc-a8d8-43cb-a9ba-e8b52c8a7ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e6c73-b2d3-44aa-bf4d-2b012ac3db14]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Volume volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 (39af0fa1-d9b1-4297-ba66-770bb18c6010): created successfully Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83864fc-a8d8-43cb-a9ba-e8b52c8a7ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Flow 'volume_create_manager' (d312a766-f6ee-408f-9f2f-ec4994583dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-aea1d8a2-acd8-4525-94ca-7162e377e4c7 tempest-VolumesTransfersTest-281623643 None] Created volume successfully. Jul 09 03:00:25 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae Jul 09 03:00:25 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "cinder-39af0fa1-d9b1-4297-ba66-770bb18c6010-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-39af0fa1-d9b1-4297-ba66-770bb18c6010-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "cinder-quobyte-39af0fa1-d9b1-4297-ba66-770bb18c6010" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-quobyte-39af0fa1-d9b1-4297-ba66-770bb18c6010" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e48f1-79eb-4f20-bd1d-39b101a18fb3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:26 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" returned: 0 in 0.827s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.856s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1e03f45-1238-49c9-b3ba-ec656eb0ea72', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:00:26 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 Jul 09 03:00:26 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-164cb156-b3c2-4e73-b2c1-110b61ae117e req-970982b1-4a7c-4c3d-9e23-e7b92279bc3b tempest-TestInstancesWithCinderVolumes-52577665 None] attachment_update completed successfully. Jul 09 03:00:27 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010" returned: 0 in 0.989s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:27 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010 Jul 09 03:00:27 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:27 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:27 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:28 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-39af0fa1-d9b1-4297-ba66-770bb18c6010" returned: 0 in 0.712s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-quobyte-39af0fa1-d9b1-4297-ba66-770bb18c6010" released by "delete_volume" :: held 1.747s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Created reservations ['a9be58b1-9492-4ca1-90c3-14555fecfe69', '4f1e3abd-a148-4eb5-b175-194f10309052', 'f6d0b6a9-fd69-47e0-a453-0508b2585a15', 'a88eb403-426a-4873-9b26-e2a7900ae520'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:28 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:28 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:28 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.737s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:00:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:00:29 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.793s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Deleted volume successfully. Jul 09 03:00:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4d26afcf-7034-4b62-9f36-5a314f03d31d tempest-VolumesTransfersTest-2098825953 None] Lock "cinder-39af0fa1-d9b1-4297-ba66-770bb18c6010-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "cinder-0387ad18-4c61-4b1e-9bc7-599cb1ef9991-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-0387ad18-4c61-4b1e-9bc7-599cb1ef9991-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "cinder-quobyte-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-quobyte-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a7d50-3601-4cf8-a07b-f0521e1d94ab]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:33 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 Jul 09 03:00:33 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:34 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" returned: 0 in 0.810s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:34 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991 Jul 09 03:00:34 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a08d3-07a6-4197-983e-fd409c613e54]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:34 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e Jul 09 03:00:34 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:35 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" returned: 0 in 0.696s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-quobyte-0387ad18-4c61-4b1e-9bc7-599cb1ef9991" released by "delete_volume" :: held 1.567s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Created reservations ['023f0d0f-6178-4859-96e7-33adae6aba63', 'dad85ac2-aa8c-475b-b841-5288d84c5398', 'b6625d0a-b993-4512-ad7f-c8f411c17810', '0b1cb297-3251-46df-9726-63920f6cb0ec'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:35 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:35 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:35 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e" returned: 0 in 0.805s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.824s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-d9accff4-b120-40d2-8259-bf7016d3e49e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d706810-49bd-4ba6-989c-6aa3a891cc77', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:00:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-3e2deb48-9d9b-4119-80c0-4e6b6f4fe2e1 req-fd92381e-68e6-4bb5-ad19-e6fb5a4940dc tempest-TestInstancesWithCinderVolumes-52577665 None] attachment_update completed successfully. Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "cinder-46073eb0-6f6c-453e-a7f8-58dab75dd01e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-46073eb0-6f6c-453e-a7f8-58dab75dd01e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "cinder-quobyte-46073eb0-6f6c-453e-a7f8-58dab75dd01e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-quobyte-46073eb0-6f6c-453e-a7f8-58dab75dd01e" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc8305-d37f-408e-92ed-abcc29f73035]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:35 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.707s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:35 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Deleted volume successfully. Jul 09 03:00:36 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:36 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Flow 'volume_create_manager' (8f80f712-5ecc-403c-b1e5-5e4a0a73c82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d82dcca-5dfb-4579-8290-3d3a1a3bf515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d82dcca-5dfb-4579-8290-3d3a1a3bf515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500693852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd918f9-ab67-4d4c-b866-cf82fe32f176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed73d936d44dfbe7c5ed352bb82e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:36Z,use_quota=True,user_id='8dbbc79d1e15430eb03afc507f2ebae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff113a-b1f8-475f-835c-987d525bd3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eff113a-b1f8-475f-835c-987d525bd3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9983ec9c-e5e4-4d2b-a1fe-4bfd4569f9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9983ec9c-e5e4-4d2b-a1fe-4bfd4569f9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd918f9-ab67-4d4c-b866-cf82fe32f176', 'volume_name': 'volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169a8ff5-a2b8-4386-9359-086b323573f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169a8ff5-a2b8-4386-9359-086b323573f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff1de7-c7b9-48c5-b173-794d870420a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:36 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Volume 9fd918f9-ab67-4d4c-b866-cf82fe32f176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176', 'volume_size': 1} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500693852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd918f9-ab67-4d4c-b866-cf82fe32f176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed73d936d44dfbe7c5ed352bb82e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:36Z,use_quota=True,user_id='8dbbc79d1e15430eb03afc507f2ebae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Creating volume 9fd918f9-ab67-4d4c-b866-cf82fe32f176 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:00:36 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4104cd96-dc6d-4652-bc1c-2b94c0ee8191 tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-0387ad18-4c61-4b1e-9bc7-599cb1ef9991-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:36 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 1073741824 Jul 09 03:00:36 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:36 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e" returned: 0 in 0.773s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:36 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e Jul 09 03:00:36 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:37 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 1073741824" returned: 0 in 0.921s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:37 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 Jul 09 03:00:37 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:37 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-46073eb0-6f6c-453e-a7f8-58dab75dd01e" returned: 0 in 0.672s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-quobyte-46073eb0-6f6c-453e-a7f8-58dab75dd01e" released by "delete_volume" :: held 1.486s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Created reservations ['7f4516cf-efb1-4803-818d-27476026824a', '0028f6c3-636d-4b3a-b881-89856f31cdbb', 'b42ccf19-11c2-4397-a00e-19d6e8627495', '2ce99327-a100-4739-ab72-2b60b2441b9e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:37 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:37 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:37 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176" returned: 0 in 0.688s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff1de7-c7b9-48c5-b173-794d870420a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b6c726-d8c6-49dc-94dc-ee6664dd0639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Volume volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 (9fd918f9-ab67-4d4c-b866-cf82fe32f176): created successfully Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b6c726-d8c6-49dc-94dc-ee6664dd0639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Flow 'volume_create_manager' (8f80f712-5ecc-403c-b1e5-5e4a0a73c82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f0fdd499-e36d-4015-8d30-4cb75c1aa5a6 tempest-VolumesTransfersV355Test-1567621820 None] Created volume successfully. Jul 09 03:00:38 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.659s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:38 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Deleted volume successfully. Jul 09 03:00:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ece57899-f2a0-4b03-bd97-2d12068a1b5d tempest-TestServerVolumeAttachmentScenario-1093201757 None] Lock "cinder-46073eb0-6f6c-453e-a7f8-58dab75dd01e-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-40ad15bb-9c19-4475-91fb-a41309cee218 tempest-VolumesTransfersV355Test-1493099712 None] Transfer volume completed successfully. Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "cinder-9fd918f9-ab67-4d4c-b866-cf82fe32f176-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-9fd918f9-ab67-4d4c-b866-cf82fe32f176-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "cinder-quobyte-9fd918f9-ab67-4d4c-b866-cf82fe32f176" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-quobyte-9fd918f9-ab67-4d4c-b866-cf82fe32f176" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e294f39d-2e39-432c-9ff9-0e7f4029275b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:39 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 Jul 09 03:00:39 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:40 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176" returned: 0 in 0.833s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:40 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176 Jul 09 03:00:40 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:41 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9fd918f9-ab67-4d4c-b866-cf82fe32f176" returned: 0 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-quobyte-9fd918f9-ab67-4d4c-b866-cf82fe32f176" released by "delete_volume" :: held 1.661s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Created reservations ['92417356-e139-48b1-8eb1-e64919bf935b', '34cfb48d-6497-4da8-9aef-5eaa1b5dd062', 'f367b5c5-f299-4921-bc79-2b350de32a0c', 'dfb6b9ea-5f43-4e3a-b8a0-6a5c264bc6fd'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:41 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:41 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:42 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.803s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:42 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Deleted volume successfully. Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a51c077f-a29d-4bad-bb5f-33a2ab5a8955 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-9fd918f9-ab67-4d4c-b866-cf82fe32f176-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Flow 'volume_create_manager' (699056ce-2c63-488e-8edd-a37eeb2481f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9201bf9-874a-4988-9e0b-dec3b89c16f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9201bf9-874a-4988-9e0b-dec3b89c16f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1840544840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560a5c33-528d-4e27-9f9e-5f4208176cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed73d936d44dfbe7c5ed352bb82e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:43Z,use_quota=True,user_id='8dbbc79d1e15430eb03afc507f2ebae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7ffe40-0478-428a-9c07-312ec7525b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7ffe40-0478-428a-9c07-312ec7525b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165c1e16-d47b-473f-a28f-bd99bc02aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165c1e16-d47b-473f-a28f-bd99bc02aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560a5c33-528d-4e27-9f9e-5f4208176cde', 'volume_name': 'volume-560a5c33-528d-4e27-9f9e-5f4208176cde', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e11d9-77ae-43cf-bd6f-3e2a4f379f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e11d9-77ae-43cf-bd6f-3e2a4f379f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dc9c42-e08b-424b-83cf-adbd9442682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:42 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Volume 560a5c33-528d-4e27-9f9e-5f4208176cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560a5c33-528d-4e27-9f9e-5f4208176cde', 'volume_size': 1} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1840544840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560a5c33-528d-4e27-9f9e-5f4208176cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed73d936d44dfbe7c5ed352bb82e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:43Z,use_quota=True,user_id='8dbbc79d1e15430eb03afc507f2ebae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Creating volume 560a5c33-528d-4e27-9f9e-5f4208176cde {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:00:42 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:00:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:42 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde 1073741824 Jul 09 03:00:42 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:43 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde 1073741824" returned: 0 in 0.941s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:43 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde Jul 09 03:00:43 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:44 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde" returned: 0 in 0.705s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dc9c42-e08b-424b-83cf-adbd9442682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560a5c33-528d-4e27-9f9e-5f4208176cde', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7073b742-0840-45c4-b6cb-02a3f43d97ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:44 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Volume volume-560a5c33-528d-4e27-9f9e-5f4208176cde (560a5c33-528d-4e27-9f9e-5f4208176cde): created successfully Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7073b742-0840-45c4-b6cb-02a3f43d97ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Flow 'volume_create_manager' (699056ce-2c63-488e-8edd-a37eeb2481f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:44 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-233ae564-4e05-4f55-bcef-622e2ab3ab54 tempest-VolumesTransfersV355Test-1567621820 None] Created volume successfully. Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "cinder-560a5c33-528d-4e27-9f9e-5f4208176cde-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-560a5c33-528d-4e27-9f9e-5f4208176cde-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "cinder-quobyte-560a5c33-528d-4e27-9f9e-5f4208176cde" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-quobyte-560a5c33-528d-4e27-9f9e-5f4208176cde" acquired by "delete_volume" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84899f4e-c1eb-4161-89b4-44a73f12b71d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:45 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde Jul 09 03:00:45 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-3438e850-13b8-4223-9a24-b90cd3650eeb req-a19e8fa5-3e10-415d-a854-22957d104b27 tempest-TestInstancesWithCinderVolumes-52577665 None] Terminate volume connection completed successfully. Jul 09 03:00:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-3438e850-13b8-4223-9a24-b90cd3650eeb req-a19e8fa5-3e10-415d-a854-22957d104b27 tempest-TestInstancesWithCinderVolumes-52577665 None] Deleting attachment e1e03f45-1238-49c9-b3ba-ec656eb0ea72. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:00:46 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:46 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde Jul 09 03:00:46 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:46 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-560a5c33-528d-4e27-9f9e-5f4208176cde" returned: 0 in 0.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-quobyte-560a5c33-528d-4e27-9f9e-5f4208176cde" released by "delete_volume" :: held 1.586s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:46 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Created reservations ['ba418eac-2214-4d03-afdc-538bc5836bca', '48e22c4b-f278-4fea-857b-9184bc71a9a5', 'f508f1b6-67f9-43e9-8491-bfea13158784', '58a9e49c-0954-404d-9494-e72dc5c57efa'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:47 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:47 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-quobyte-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" acquired by "delete_volume" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a06a5-1c92-46dc-b225-dc5f76100cdd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:47 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae Jul 09 03:00:47 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:47 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.916s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:47 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Deleted volume successfully. Jul 09 03:00:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-55663446-6192-42b7-ac68-08ba7225df02 tempest-VolumesTransfersV355Test-163459078 None] Lock "cinder-560a5c33-528d-4e27-9f9e-5f4208176cde-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:48 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" returned: 0 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:48 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae Jul 09 03:00:48 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:49 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" returned: 0 in 0.795s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae" released by "delete_volume" :: held 1.870s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=89,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:00:49 devstack cinder-volume[87156]: WARNING cinder.quota [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-883224373-250229959 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-883224373-250229959, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:00:49 devstack cinder-volume[87156]: WARNING cinder.quota [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-883224373-250229959 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-883224373-250229959, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Created reservations ['a142f35d-3c26-445f-8c50-08073980c9c2', '751b5efd-aa74-42bd-9c9f-f8ec8781bf5c', '6b97063c-c205-4dda-939e-436b8d1f3cc4', '47316b6f-9c8f-4b84-9699-dfb7e3b4af2f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:49 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:49 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:50 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:50 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Deleted volume successfully. Jul 09 03:00:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-0e117eb5-b34a-4ae8-bb26-9db1cceaccf8 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-6fdf199d-9286-44f8-935b-e0c4dc1dd1ae-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:52 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:INSERT=25,cinder:UPDATE=85,cinder:SELECT=84,cinder:DELETE=7 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:00:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-1a30b800-badd-44fd-904b-7c54d9f3f9ab req-634500a0-7175-4be3-a3b0-ec8c3cbc1c8a tempest-TestInstancesWithCinderVolumes-52577665 None] Terminate volume connection completed successfully. Jul 09 03:00:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-1a30b800-badd-44fd-904b-7c54d9f3f9ab req-634500a0-7175-4be3-a3b0-ec8c3cbc1c8a tempest-TestInstancesWithCinderVolumes-52577665 None] Deleting attachment 4d706810-49bd-4ba6-989c-6aa3a891cc77. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Flow 'volume_create_manager' (e016357c-03cb-424c-b1ea-f6340c02210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263d8c5-98ec-4348-82ed-e50ab526dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263d8c5-98ec-4348-82ed-e50ab526dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2054865464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c08888-91dd-4495-ae42-3b4d6125a624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9288f3f6c5494a93983566c11d8f718c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:54Z,use_quota=True,user_id='4dfa2d2396e946e4975ff9d646be51d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2684a7-7ebe-4ac3-8037-c9542e0dfb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2684a7-7ebe-4ac3-8037-c9542e0dfb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cfee32-1819-43c0-9f59-3bbd8222cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cfee32-1819-43c0-9f59-3bbd8222cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c08888-91dd-4495-ae42-3b4d6125a624', 'volume_name': 'volume-e6c08888-91dd-4495-ae42-3b4d6125a624', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfeaff1-20de-4a55-8fd4-a7ebf5954cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfeaff1-20de-4a55-8fd4-a7ebf5954cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1ba832-7ae2-4284-9f61-6cdb8aef35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Volume e6c08888-91dd-4495-ae42-3b4d6125a624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c08888-91dd-4495-ae42-3b4d6125a624', 'volume_size': 1} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2054865464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c08888-91dd-4495-ae42-3b4d6125a624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9288f3f6c5494a93983566c11d8f718c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:54Z,use_quota=True,user_id='4dfa2d2396e946e4975ff9d646be51d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Creating volume e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:00:54 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:54 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 1073741824 Jul 09 03:00:54 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-d9accff4-b120-40d2-8259-bf7016d3e49e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-d9accff4-b120-40d2-8259-bf7016d3e49e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-quobyte-d9accff4-b120-40d2-8259-bf7016d3e49e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-d9accff4-b120-40d2-8259-bf7016d3e49e" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f23b53-9bfb-4ec5-a436-1b2df3a6475c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:55 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e Jul 09 03:00:55 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:55 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 1073741824" returned: 0 in 1.215s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:55 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:00:55 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:56 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e" returned: 0 in 1.095s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:56 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e Jul 09 03:00:56 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:56 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.968s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1ba832-7ae2-4284-9f61-6cdb8aef35f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c08888-91dd-4495-ae42-3b4d6125a624', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6770885a-9eab-40e4-8c2e-672377a235da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Volume volume-e6c08888-91dd-4495-ae42-3b4d6125a624 (e6c08888-91dd-4495-ae42-3b4d6125a624): created successfully Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6770885a-9eab-40e4-8c2e-672377a235da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Flow 'volume_create_manager' (e016357c-03cb-424c-b1ea-f6340c02210a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1eee00d6-2576-4d42-af7a-ef856a48b8c4 tempest-VolumesCloneTest-956422904 None] Created volume successfully. Jul 09 03:00:57 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d9accff4-b120-40d2-8259-bf7016d3e49e" returned: 0 in 0.948s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-d9accff4-b120-40d2-8259-bf7016d3e49e" released by "delete_volume" :: held 2.123s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:57 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754071097-902103911 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754071097-902103911, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:00:57 devstack cinder-volume[87156]: WARNING cinder.quota [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754071097-902103911 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754071097-902103911, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Created reservations ['9b85e83b-ec7c-4cd6-9267-90f2d402cd77', '8767f8f2-496e-48fb-a5fa-6f99cc0147c6', '41cf1c9b-1d92-47cb-af0d-ada1226c60f2', 'bd392e51-41d9-4062-8ddf-30cbc1af5024'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:00:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:57 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:00:57 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Flow 'volume_create_manager' (eb4cab06-f23a-49f3-acb2-e55417cca5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517e759-40c4-4eaf-976d-c6b6b11724e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2517e759-40c4-4eaf-976d-c6b6b11724e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-912256855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d174aa6e-4c56-4027-a40c-c129fc1ae217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9288f3f6c5494a93983566c11d8f718c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:00:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e6c08888-91dd-4495-ae42-3b4d6125a624,status='creating',terminated_at=None,updated_at=2026-07-09T01:00:58Z,use_quota=True,user_id='4dfa2d2396e946e4975ff9d646be51d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e89f8-ae66-425b-a8d1-e014d4273d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e89f8-ae66-425b-a8d1-e014d4273d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca5066-88d0-4e2e-a5c4-3c1ea282153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca5066-88d0-4e2e-a5c4-3c1ea282153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd174aa6e-4c56-4027-a40c-c129fc1ae217', 'volume_name': 'volume-d174aa6e-4c56-4027-a40c-c129fc1ae217', 'volume_size': 2, 'source_volid': 'e6c08888-91dd-4495-ae42-3b4d6125a624', 'source_volstatus': 'available'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440bd5d5-15c1-498f-bcf3-c71bf04bc6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440bd5d5-15c1-498f-bcf3-c71bf04bc6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fea8b3e-fb90-4b96-a3b0-4e4c6afa1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:00:58 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Volume d174aa6e-4c56-4027-a40c-c129fc1ae217: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d174aa6e-4c56-4027-a40c-c129fc1ae217', 'volume_size': 2, 'source_volid': 'e6c08888-91dd-4495-ae42-3b4d6125a624', 'source_volstatus': 'available'} Jul 09 03:00:58 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:00:58 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Cloning volume e6c08888-91dd-4495-ae42-3b4d6125a624 to volume d174aa6e-4c56-4027-a40c-c129fc1ae217 Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.156s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:00:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Deleted volume successfully. Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Creating offline snapshot a32e5d8a-8803-4905-9c67-aea5e3dcccdf of volume e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d43efba6-5e85-4ee0-a7dd-29641fcc8880 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-d9accff4-b120-40d2-8259-bf7016d3e49e-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129a268-2039-42c0-8e91-932bb6305178]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:00:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:58 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:00:58 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:00:59 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 09 03:00:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.961s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:00:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:00:59 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf 1G Jul 09 03:00:59 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:00 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf 1G" returned: 0 in 1.118s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c08888-91dd-4495-ae42-3b4d6125a624 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:00 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c08888-91dd-4495-ae42-3b4d6125a624 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:00 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:01 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c08888-91dd-4495-ae42-3b4d6125a624 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.829s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:01 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf is being set with open permissions: ugo+rw Jul 09 03:01:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:01 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:01 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:02 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:02 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info Jul 09 03:01:02 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:02 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-50550da2-e7f8-43c1-bf35-28f3e633e557 req-63b9a160-f91b-4c9c-a7dc-e0cfabd3a5dd tempest-TestInstancesWithCinderVolumes-52577665 None] Terminate volume connection completed successfully. Jul 09 03:01:02 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-50550da2-e7f8-43c1-bf35-28f3e633e557 req-63b9a160-f91b-4c9c-a7dc-e0cfabd3a5dd tempest-TestInstancesWithCinderVolumes-52577665 None] Deleting attachment af5e0ae7-f183-4147-bb16-e62275420de2. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:01:02 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info" returned: 0 in 0.712s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:02 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info is being set with open permissions: ugo+rw Jul 09 03:01:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:02 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info Jul 09 03:01:02 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:03 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.info" returned: 0 in 0.709s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] snapshot: a32e5d8a-8803-4905-9c67-aea5e3dcccdf, volume: d174aa6e-4c56-4027-a40c-c129fc1ae217, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c58c04-7d4e-413a-8cf2-deb2c5569dfc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:03 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:03 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:04 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c08888-91dd-4495-ae42-3b4d6125a624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7e5b6-1f15-4d35-bbd8-f716b34bd0f1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:04 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:01:04 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:05 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.837s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:05 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:01:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:05 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 Jul 09 03:01:05 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-6dbddc5b-47da-4a66-b160-915e715e6656-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-6dbddc5b-47da-4a66-b160-915e715e6656-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "cinder-quobyte-6dbddc5b-47da-4a66-b160-915e715e6656" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-6dbddc5b-47da-4a66-b160-915e715e6656" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd2e26-4846-4ce2-a1ea-365fedd7bfd9]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:07 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 03:01:07 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:08 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 1.566s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:08 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 03:01:08 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:10 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 1 in 1.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:10 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656 Jul 09 03:01:10 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:10 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217" returned: 0 in 5.368s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f9dc55-e3f7-475d-9627-6db743ae1949]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:10 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:01:10 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:11 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dbddc5b-47da-4a66-b160-915e715e6656" returned: 0 in 0.867s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-quobyte-6dbddc5b-47da-4a66-b160-915e715e6656" released by "delete_volume" :: held 4.401s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:11 devstack cinder-volume[87156]: WARNING cinder.quota [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1678836631-1296657936 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1678836631-1296657936, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:01:11 devstack cinder-volume[87156]: WARNING cinder.quota [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1678836631-1296657936 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1678836631-1296657936, it is now deprecated. Please use the default quota class for default quota. Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Created reservations ['901118c0-af63-43fa-8bd7-9753129db3ea', '9d673720-ceda-4876-8922-e07893d6396f', '3674b352-4eed-4f85-81f3-f4854ddfbd28', '1e46d7fb-576c-4f57-a834-812afbbce4c6'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:11 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:01:11 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:11 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 1.095s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:01:11 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Converted 1024.00 MB image at 190.66 MB/s Jul 09 03:01:11 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 is being set with open permissions: ugo+rw Jul 09 03:01:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:11 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 Jul 09 03:01:11 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:12 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.928s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:01:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Deleted volume successfully. Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-20180fac-0361-4990-b934-2b108138e250 tempest-TestInstancesWithCinderVolumes-52577665 None] Lock "cinder-6dbddc5b-47da-4a66-b160-915e715e6656-delete_volume" released by "delete_volume" :: held 5.630s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:12 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217" returned: 0 in 0.966s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" released by "_copy_volume_from_snapshot" :: held 9.238s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-quobyte-a32e5d8a-8803-4905-9c67-aea5e3dcccdf" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-a32e5d8a-8803-4905-9c67-aea5e3dcccdf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Deleting offline snapshot a32e5d8a-8803-4905-9c67-aea5e3dcccdf of volume e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] snapshot_file for this snap is: volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a15d3-f777-4987-b3f9-bef840c4cfa2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:13 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:13 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:13 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.846s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c08888-91dd-4495-ae42-3b4d6125a624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65a5a8-099d-4443-bebd-da371f0df2c1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:14 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:01:14 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:14 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.890s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:14 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:14 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:15 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.869s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:15 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf Jul 09 03:01:15 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:16 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624.a32e5d8a-8803-4905-9c67-aea5e3dcccdf" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-a32e5d8a-8803-4905-9c67-aea5e3dcccdf" released by "_delete_snapshot" :: held 3.485s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.052s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fea8b3e-fb90-4b96-a3b0-4e4c6afa1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d174aa6e-4c56-4027-a40c-c129fc1ae217', 'volume_size': 2, 'source_volid': 'e6c08888-91dd-4495-ae42-3b4d6125a624', 'source_volstatus': 'available'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9f8f9e-1642-4b52-b545-ac9ed6c71a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Volume volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 (d174aa6e-4c56-4027-a40c-c129fc1ae217): created successfully Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9f8f9e-1642-4b52-b545-ac9ed6c71a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Flow 'volume_create_manager' (eb4cab06-f23a-49f3-acb2-e55417cca5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-13adc88b-7979-463f-83cd-f41a5b07a926 tempest-VolumesCloneTest-956422904 None] Created volume successfully. Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-d174aa6e-4c56-4027-a40c-c129fc1ae217-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "cinder-d174aa6e-4c56-4027-a40c-c129fc1ae217-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3543432-56da-4839-8a30-b518f053fcb1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:17 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 Jul 09 03:01:17 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:18 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217" returned: 0 in 0.855s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:18 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217 Jul 09 03:01:18 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:18 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d174aa6e-4c56-4027-a40c-c129fc1ae217" returned: 0 in 0.727s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-d174aa6e-4c56-4027-a40c-c129fc1ae217" released by "delete_volume" :: held 1.643s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Flow 'volume_create_manager' (51914b91-46d7-4449-8d86-90089981f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c0ecff-cb14-4587-933e-cba521b18bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c0ecff-cb14-4587-933e-cba521b18bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-360775655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1851b3-b37f-4694-bf99-8293fb50f2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ffb231e7e84058b9107b42287cf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:19Z,use_quota=True,user_id='8997aac92fc44dc382dca250def2bef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bb7aa-3c67-4ded-aedb-841d0d6a69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bb7aa-3c67-4ded-aedb-841d0d6a69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8810800-6991-4af1-8cba-dbf7dd559973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:01:18 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Created reservations ['c9fd2782-c2c3-4f67-8cb4-8894a8309ef8', '246572b3-3a4a-44fc-ad34-11c8b134daf6', '35f37163-9f0b-4646-8b86-4dea490ec437', '8125fbc6-cfcf-463d-acb1-c07b61e6a994'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:19 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:01:19 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8810800-6991-4af1-8cba-dbf7dd559973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'volume_name': 'volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bba55d-c6b5-4165-936e-f6cb02b242de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bba55d-c6b5-4165-936e-f6cb02b242de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de09b818-bd23-4ec8-b4d6-f279d25dbec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:19 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Volume ce1851b3-b37f-4694-bf99-8293fb50f2ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Trying to clone ce1851b3-b37f-4694-bf99-8293fb50f2ad from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-e6c08888-91dd-4495-ae42-3b4d6125a624-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "cinder-e6c08888-91dd-4495-ae42-3b4d6125a624-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Acquiring lock "cinder-quobyte-e6c08888-91dd-4495-ae42-3b4d6125a624" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-e6c08888-91dd-4495-ae42-3b4d6125a624" acquired by "delete_volume" :: waited 0.050s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b840b4-a3c2-423b-bcb5-d4ae48872be3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:01:19 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Image download 20.69 MB at 20.69 MB/s Jul 09 03:01:19 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:01:19 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:19 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.920s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:19 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:01:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Deleted volume successfully. Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d00c6b4-8f75-437d-bbe2-794898df2084]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9da0eb5c-8dcc-4c7c-bc84-526a06b0805e tempest-VolumesCloneTest-956422904 None] Lock "cinder-d174aa6e-4c56-4027-a40c-c129fc1ae217-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:20 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD Jul 09 03:01:20 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:20 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.931s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:20 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624 Jul 09 03:01:20 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:20 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 is fetched for user 8997aac92fc44dc382dca250def2bef3. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f86c1bb-9e1e-4b8a-8114-e5d226ea4cc5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:21 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD Jul 09 03:01:21 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:21 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e6c08888-91dd-4495-ae42-3b4d6125a624" returned: 0 in 0.742s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "cinder-quobyte-e6c08888-91dd-4495-ae42-3b4d6125a624" released by "delete_volume" :: held 1.820s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Created reservations ['88d25d7b-3af4-4252-b11d-0437985d753f', 'ee011f24-f239-4a8e-ad28-a0865c15c7da', '1d95555f-79d8-488b-b261-702ce11d614e', '044d4448-2658-47b3-82ed-182a1e13eaf3'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:21 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:01:21 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:21 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-360775655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1851b3-b37f-4694-bf99-8293fb50f2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ffb231e7e84058b9107b42287cf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:19Z,use_quota=True,user_id='8997aac92fc44dc382dca250def2bef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Creating volume ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:01:21 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:01:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:21 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1073741824 Jul 09 03:01:21 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:22 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.905s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:22 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:01:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Deleted volume successfully. Jul 09 03:01:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bf629c12-5355-48d0-aa69-a86b2624e352 tempest-VolumesCloneTest-956422904 None] Lock "cinder-e6c08888-91dd-4495-ae42-3b4d6125a624-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:01:22 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1073741824" returned: 0 in 1.137s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:23 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:23 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:23 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.761s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Attempting download of db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume ce1851b3-b37f-4694-bf99-8293fb50f2ad. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fedb560-cf5e-4e5a-bbdc-b213248f29e1]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:23 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1 Jul 09 03:01:23 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:24 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1" returned: 0 in 0.847s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:24 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1 Jul 09 03:01:24 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:25 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1" returned: 1 in 0.830s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9c7883-aaf0-4c13-905a-75c00f73e5a1_59m8v_y1' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d72d0c-1cd6-467d-ae34-e1cf1704abfe]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Flow 'volume_create_manager' (81dbadff-da84-42e4-a7de-acce9b24db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b7b7d1-b385-4165-b242-d4e587430bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:25 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD Jul 09 03:01:25 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b7b7d1-b385-4165-b242-d4e587430bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1480491496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80740818-033f-44d5-ba7a-e7468918d2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b5eb9b2a564c099a558d2442f6a03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:26Z,use_quota=True,user_id='47a1a5edf76241cb8001f440e676d165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d00825-1497-4cb6-a01f-8b4894fa9f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d00825-1497-4cb6-a01f-8b4894fa9f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df4ac3f-c146-4d29-955d-d655eb26217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df4ac3f-c146-4d29-955d-d655eb26217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80740818-033f-44d5-ba7a-e7468918d2ff', 'volume_name': 'volume-80740818-033f-44d5-ba7a-e7468918d2ff', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e37df2d-b9d9-4548-a0a9-c7b21bccc6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e37df2d-b9d9-4548-a0a9-c7b21bccc6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df39f1-17b3-4004-ba52-9132ef0d006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Volume 80740818-033f-44d5-ba7a-e7468918d2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80740818-033f-44d5-ba7a-e7468918d2ff', 'volume_size': 1} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1480491496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80740818-033f-44d5-ba7a-e7468918d2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b5eb9b2a564c099a558d2442f6a03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:01:26Z,use_quota=True,user_id='47a1a5edf76241cb8001f440e676d165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Creating volume 80740818-033f-44d5-ba7a-e7468918d2ff {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:01:25 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:01:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:25 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff 1073741824 Jul 09 03:01:25 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:26 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:26 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] db9c7883-aaf0-4c13-905a-75c00f73e5a1 was qcow2, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:01:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:26 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:26 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:26 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff 1073741824" returned: 0 in 1.006s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:26 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff Jul 09 03:01:26 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:27 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df39f1-17b3-4004-ba52-9132ef0d006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80740818-033f-44d5-ba7a-e7468918d2ff', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc85efc-af14-4379-ba10-24c58ce90eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Volume volume-80740818-033f-44d5-ba7a-e7468918d2ff (80740818-033f-44d5-ba7a-e7468918d2ff): created successfully Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc85efc-af14-4379-ba10-24c58ce90eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Flow 'volume_create_manager' (81dbadff-da84-42e4-a7de-acce9b24db8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f338aa34-44f7-4c53-a24b-be6fb749951e tempest-VolumesNegativeTest-1906430002 None] Created volume successfully. Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:27 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:01:27 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:28 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 2.327s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db9c7883-aaf0-4c13-905a-75c00f73e5a1_ucx06pxddevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:01:28 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Converted 112.00 MB image at 48.11 MB/s Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:28 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1G Jul 09 03:01:28 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:28 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.981s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:01:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:01:29 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad 1G" returned: 0 in 0.909s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f44d6-4e42-4ba8-999a-1c1897265e32]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:29 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:29 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:30 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.791s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:30 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:30 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:31 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 1 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Downloaded image db9c7883-aaf0-4c13-905a-75c00f73e5a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}])) to volume ce1851b3-b37f-4694-bf99-8293fb50f2ad successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Temporary image db9c7883-aaf0-4c13-905a-75c00f73e5a1 for user 8997aac92fc44dc382dca250def2bef3 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Marking volume ce1851b3-b37f-4694-bf99-8293fb50f2ad as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Copying metadata from image db9c7883-aaf0-4c13-905a-75c00f73e5a1 to ce1851b3-b37f-4694-bf99-8293fb50f2ad. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Creating volume glance metadata for volume ce1851b3-b37f-4694-bf99-8293fb50f2ad backed by image db9c7883-aaf0-4c13-905a-75c00f73e5a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de09b818-bd23-4ec8-b4d6-f279d25dbec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'volume_size': 1, 'image_id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b289dfea44e4fc4a48d377ea52eae3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db9c7883-aaf0-4c13-905a-75c00f73e5a1', 'created_at': datetime.datetime(2026, 7, 9, 0, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 0, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9c7883-aaf0-4c13-905a-75c00f73e5a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a5fa4a-f70c-4865-a2dc-d89516d3665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:01:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Volume volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad (ce1851b3-b37f-4694-bf99-8293fb50f2ad): created successfully Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a5fa4a-f70c-4865-a2dc-d89516d3665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:01:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Flow 'volume_create_manager' (51914b91-46d7-4449-8d86-90089981f663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:01:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1544a781-758f-4781-b747-aa5dc8bd35b4 tempest-TestShelveInstance-460332655 None] Created volume successfully. Jul 09 03:01:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:01:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:01:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a811cb-d058-431e-ba62-9c5428140918]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:01:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:39 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:39 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:40 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.940s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:01:40 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:01:40 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:01:41 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 09 03:01:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 1 in 0.871s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:01:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:01:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.894s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:01:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb0c9cc3-d162-4b9b-9e36-03083c73db43', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:01:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-493f014e-8316-4907-86e7-b441024c5c57 req-9d35e358-7e47-49c9-92cf-cae9a25cc36d tempest-TestShelveInstance-460332655 None] attachment_update completed successfully. Jul 09 03:01:51 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=45,cinder:UPDATE=45,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:01:55 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:INSERT=22,cinder:UPDATE=58,cinder:SELECT=49,cinder:DELETE=8 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Acquiring lock "cinder-80740818-033f-44d5-ba7a-e7468918d2ff-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "cinder-80740818-033f-44d5-ba7a-e7468918d2ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Acquiring lock "cinder-quobyte-80740818-033f-44d5-ba7a-e7468918d2ff" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "cinder-quobyte-80740818-033f-44d5-ba7a-e7468918d2ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[648fae0e-5671-4ed4-9e7f-7bd4d0b4998f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:03 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff Jul 09 03:02:03 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:04 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff" returned: 0 in 1.091s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:04 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff Jul 09 03:02:04 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:05 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-80740818-033f-44d5-ba7a-e7468918d2ff" returned: 0 in 0.770s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "cinder-quobyte-80740818-033f-44d5-ba7a-e7468918d2ff" released by "delete_volume" :: held 1.920s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Created reservations ['dc70aae4-e651-4bb0-82a9-b79bd9dc2bd8', '5b93fa5f-4a51-45f0-90cb-30c96f04eadc', 'cbcdcc78-8916-42a3-8311-c9fba1ad01a2', '44fbce36-7702-4db7-8aca-0f97ea2e94be'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:05 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:02:05 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:05 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Deleted volume successfully. Jul 09 03:02:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d78868a0-1764-44a8-8cd1-9c1e7b9a0f69 tempest-VolumesNegativeTest-1906430002 None] Lock "cinder-80740818-033f-44d5-ba7a-e7468918d2ff-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:02:15 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:15 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:16 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:02:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Flow 'volume_create_manager' (f83f6eb4-0ea8-4b1c-ae2d-c07f052ec769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b4ac9-0910-4203-8c63-49948c364f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b4ac9-0910-4203-8c63-49948c364f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2144289746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3236ece-3ff7-41a6-902f-26b3c91373b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a70d989d42548b1af235ff6abaceeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:17Z,use_quota=True,user_id='9545d130b2c34d77b979cdb7b0898277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341411ce-6937-4796-b8a0-09ef9b477836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341411ce-6937-4796-b8a0-09ef9b477836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d19d49c-e7de-432e-a564-5e2c8a0ea38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d19d49c-e7de-432e-a564-5e2c8a0ea38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3236ece-3ff7-41a6-902f-26b3c91373b7', 'volume_name': 'volume-a3236ece-3ff7-41a6-902f-26b3c91373b7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e7ebd-7c33-4fb5-b8f6-5f0700b55b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e7ebd-7c33-4fb5-b8f6-5f0700b55b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fae0cf4-c2e8-4028-b411-a35c743bf0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Volume a3236ece-3ff7-41a6-902f-26b3c91373b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3236ece-3ff7-41a6-902f-26b3c91373b7', 'volume_size': 1} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2144289746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3236ece-3ff7-41a6-902f-26b3c91373b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a70d989d42548b1af235ff6abaceeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:17Z,use_quota=True,user_id='9545d130b2c34d77b979cdb7b0898277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Creating volume a3236ece-3ff7-41a6-902f-26b3c91373b7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:02:17 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:02:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:17 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 1073741824 Jul 09 03:02:17 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:18 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 1073741824" returned: 0 in 1.063s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:18 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 Jul 09 03:02:18 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:18 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fae0cf4-c2e8-4028-b411-a35c743bf0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3236ece-3ff7-41a6-902f-26b3c91373b7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02d9dc0-03b6-4743-bd2d-e05cb3db4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Volume volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 (a3236ece-3ff7-41a6-902f-26b3c91373b7): created successfully Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02d9dc0-03b6-4743-bd2d-e05cb3db4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Flow 'volume_create_manager' (f83f6eb4-0ea8-4b1c-ae2d-c07f052ec769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-549e91eb-d5ae-4171-a25a-ae6d1576faa6 tempest-TestMinimumBasicScenario-1837238714 None] Created volume successfully. Jul 09 03:02:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-01d17da4-fa92-422c-99fe-f56466384da3 req-d7c3030d-a27f-4053-8a10-a872a7fe87c3 tempest-TestShelveInstance-460332655 None] Terminate volume connection completed successfully. Jul 09 03:02:22 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-01d17da4-fa92-422c-99fe-f56466384da3 req-d7c3030d-a27f-4053-8a10-a872a7fe87c3 tempest-TestShelveInstance-460332655 None] Deleting attachment bb0c9cc3-d162-4b9b-9e36-03083c73db43. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:02:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[57050033-2802-4eb3-a4e4-43d77aaaaa3b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:23 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 Jul 09 03:02:23 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:23 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7" returned: 0 in 0.984s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.031s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-a3236ece-3ff7-41a6-902f-26b3c91373b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abb25c1e-23f4-4870-bcf8-85a1074bfbf7', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:02:24 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-f8a104a8-92d6-48f6-99eb-46ec138bb869 req-f2b08d95-18f8-4f18-a9fb-edc2d2a8062c tempest-TestMinimumBasicScenario-1837238714 None] attachment_update completed successfully. Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:27 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:02:27 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:28 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:02:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:02:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:02:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:02:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[55954e9a-fa56-4e21-a013-1bf09949fe1c]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:02:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:29 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:02:29 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:30 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.932s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:30 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:02:30 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:31 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 1 in 0.878s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:02:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.868s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '955da26e-8a00-4a79-8aad-3951b28baab3', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:02:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-712e829a-f4ab-47e3-ad0b-e841d6b20fdf req-e37bcf66-a478-497d-b576-20bb5b4a5918 tempest-TestShelveInstance-460332655 None] attachment_update completed successfully. Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Flow 'volume_create_manager' (eba3e9bf-9986-4343-9c83-06279a50bc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0eda4d-4a65-4120-85b1-0d98745c6c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0eda4d-4a65-4120-85b1-0d98745c6c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-97287069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d929ba-6aec-490b-9108-dda96268d23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a8d59dfe504391bc74d83fc8f32b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:36Z,use_quota=True,user_id='bee4000102ec4278bf297665b7fc44f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827b4c7f-f709-44ce-b923-206747e8514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827b4c7f-f709-44ce-b923-206747e8514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befff14a-dc7c-4705-8f84-08d57ba231ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befff14a-dc7c-4705-8f84-08d57ba231ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d929ba-6aec-490b-9108-dda96268d23b', 'volume_name': 'volume-24d929ba-6aec-490b-9108-dda96268d23b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1d77ed-8f47-45fd-ad59-3ec9d8a785cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1d77ed-8f47-45fd-ad59-3ec9d8a785cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e4599-338a-4491-a208-8617effe3722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:35 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Volume 24d929ba-6aec-490b-9108-dda96268d23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d929ba-6aec-490b-9108-dda96268d23b', 'volume_size': 1} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-97287069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d929ba-6aec-490b-9108-dda96268d23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a8d59dfe504391bc74d83fc8f32b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:02:36Z,use_quota=True,user_id='bee4000102ec4278bf297665b7fc44f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Creating volume 24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:02:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:02:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:02:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:02:36 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:02:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:36 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b 1073741824 Jul 09 03:02:36 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:36 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b 1073741824" returned: 0 in 0.997s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:02:37 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:02:37 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:02:37 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.808s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e4599-338a-4491-a208-8617effe3722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d929ba-6aec-490b-9108-dda96268d23b', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7630d9e-29e8-44a2-b7c6-df5619e17231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:02:37 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Volume volume-24d929ba-6aec-490b-9108-dda96268d23b (24d929ba-6aec-490b-9108-dda96268d23b): created successfully Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7630d9e-29e8-44a2-b7c6-df5619e17231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:02:37 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Flow 'volume_create_manager' (eba3e9bf-9986-4343-9c83-06279a50bc03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:02:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-611c23b8-8201-4eb7-a651-9bd3fc843a18 tempest-TestStampPattern-1785615215 None] Created volume successfully. Jul 09 03:02:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=15,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:02:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e767158-650d-4df9-89c9-883216562aa3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:18 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:03:18 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:18 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.863s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-24d929ba-6aec-490b-9108-dda96268d23b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9c0d885-c68c-48a7-893d-fd54a99ecfc0', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:03:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-5965e67f-6cc1-4f7a-b795-444ec9f51f93 req-e9615cdc-44cb-4efe-bdd7-b498ecd6e5d9 tempest-TestStampPattern-1785615215 None] attachment_update completed successfully. Jul 09 03:03:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-db7b6f42-9308-4458-aba1-3b7415522771 req-28168121-1fb0-4885-a142-feb98502c27f tempest-TestMinimumBasicScenario-1837238714 None] Terminate volume connection completed successfully. Jul 09 03:03:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-db7b6f42-9308-4458-aba1-3b7415522771 req-28168121-1fb0-4885-a142-feb98502c27f tempest-TestMinimumBasicScenario-1837238714 None] Deleting attachment abb25c1e-23f4-4870-bcf8-85a1074bfbf7. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "cinder-a3236ece-3ff7-41a6-902f-26b3c91373b7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "cinder-a3236ece-3ff7-41a6-902f-26b3c91373b7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "cinder-quobyte-a3236ece-3ff7-41a6-902f-26b3c91373b7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "cinder-quobyte-a3236ece-3ff7-41a6-902f-26b3c91373b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d74a8d-4de6-4da5-8c5c-e182abfbf9d9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:24 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 Jul 09 03:03:24 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:25 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7" returned: 0 in 0.968s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:25 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7 Jul 09 03:03:25 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-8be224a7-b956-46d1-9ec9-0d956d014410 tempest-TestShelveInstance-460332655 None] Terminate volume connection completed successfully. Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-8be224a7-b956-46d1-9ec9-0d956d014410 tempest-TestShelveInstance-460332655 None] Deleting attachment 955da26e-8a00-4a79-8aad-3951b28baab3. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:03:25 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a3236ece-3ff7-41a6-902f-26b3c91373b7" returned: 0 in 0.686s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "cinder-quobyte-a3236ece-3ff7-41a6-902f-26b3c91373b7" released by "delete_volume" :: held 1.710s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Created reservations ['c9a4f7fb-9cb9-4c57-9f6b-864d1bbe4209', 'f24de7f3-db4b-4aaa-9b09-9686f2765b9c', '78ced6c2-16f4-4959-b992-abe601ec20c5', 'a05237a0-eeee-437a-b39c-5c437b72a163'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:25 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:03:25 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Acquiring lock "cinder-ce1851b3-b37f-4694-bf99-8293fb50f2ad-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "cinder-ce1851b3-b37f-4694-bf99-8293fb50f2ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Acquiring lock "cinder-quobyte-ce1851b3-b37f-4694-bf99-8293fb50f2ad" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "cinder-quobyte-ce1851b3-b37f-4694-bf99-8293fb50f2ad" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a0f873-1a9c-4b21-a72b-0d21fcfd74ea]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:26 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.795s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Deleted volume successfully. Jul 09 03:03:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-74568579-8a7f-4c38-ab62-fa9992f0997b tempest-TestMinimumBasicScenario-1837238714 None] Lock "cinder-a3236ece-3ff7-41a6-902f-26b3c91373b7-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:26 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:03:26 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:27 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.866s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:27 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:03:27 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:27 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:03:27 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-1d9931f5-bc16-4c64-9da4-c1968834227d req-5f133d34-874e-41c6-a1df-f15fd09ad948 tempest-TestStampPattern-1785615215 None] Terminate volume connection completed successfully. Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-1d9931f5-bc16-4c64-9da4-c1968834227d req-5f133d34-874e-41c6-a1df-f15fd09ad948 tempest-TestStampPattern-1785615215 None] Deleting attachment a9c0d885-c68c-48a7-893d-fd54a99ecfc0. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:03:28 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 1 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:28 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad Jul 09 03:03:28 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:28 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.033s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:03:29 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ce1851b3-b37f-4694-bf99-8293fb50f2ad" returned: 0 in 0.911s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "cinder-quobyte-ce1851b3-b37f-4694-bf99-8293fb50f2ad" released by "delete_volume" :: held 2.880s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.quota [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Created reservations ['12525a1a-e7b2-4a08-8e56-2edfb3eb74a2', 'a8b73ab8-4f72-4709-aa06-b0e88a892645', 'c1a55edb-447c-46cf-964f-5f8d8b4810af', 'c9e055dd-f931-407c-ab0a-478313f91cbf'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:29 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:03:29 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:30 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Creating offline snapshot 9ef275ad-7ebe-45e9-9586-a705bde35405 of volume 24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.755s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG cinder.manager [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Deleted volume successfully. Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac04f37-f3da-4984-9251-cc3f54a37453]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [req-28cf2015-bcbc-469d-b25c-4b65d677ce58 req-28b109df-1fa5-4f83-9ef8-2c1bc47a21c3 tempest-TestShelveInstance-460332655 None] Lock "cinder-ce1851b3-b37f-4694-bf99-8293fb50f2ad-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:30 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:03:30 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:31 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.831s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:31 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 1G Jul 09 03:03:31 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:32 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 1G" returned: 0 in 0.886s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d929ba-6aec-490b-9108-dda96268d23b -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:32 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d929ba-6aec-490b-9108-dda96268d23b -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:03:32 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:32 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d929ba-6aec-490b-9108-dda96268d23b -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 0.794s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:32 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 is being set with open permissions: ugo+rw Jul 09 03:03:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:32 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:03:32 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:33 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 0.904s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:33 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info Jul 09 03:03:33 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:34 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:34 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info is being set with open permissions: ugo+rw Jul 09 03:03:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:34 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info Jul 09 03:03:34 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:35 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.info" returned: 0 in 0.706s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-52956ccf-7aae-4c04-9a8f-f26b5f0788f1 tempest-TestStampPattern-1785615215 None] Create snapshot completed successfully Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (039cfca3-0d0a-4554-849c-a9c4b171eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d9d626-8f99-4706-92d1-e5157ca5b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d9d626-8f99-4706-92d1-e5157ca5b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757266424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a00f12-c5ca-42c9-8352-1a4851289a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:42Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a569357-f2e7-461e-b21e-19694dffe22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a569357-f2e7-461e-b21e-19694dffe22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b54a8-c68b-4528-8182-adc0257541e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8b54a8-c68b-4528-8182-adc0257541e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a00f12-c5ca-42c9-8352-1a4851289a0f', 'volume_name': 'volume-11a00f12-c5ca-42c9-8352-1a4851289a0f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ac13ad-8274-4fa7-a5b3-e581769695d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ac13ad-8274-4fa7-a5b3-e581769695d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e7464b-0794-4a26-b7e3-a9025f04ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume 11a00f12-c5ca-42c9-8352-1a4851289a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a00f12-c5ca-42c9-8352-1a4851289a0f', 'volume_size': 1} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757266424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a00f12-c5ca-42c9-8352-1a4851289a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:42Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume 11a00f12-c5ca-42c9-8352-1a4851289a0f {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:41 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:41 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f 1073741824 Jul 09 03:03:41 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:42 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f 1073741824" returned: 0 in 0.900s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:42 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f Jul 09 03:03:42 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:43 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f" returned: 0 in 0.685s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e7464b-0794-4a26-b7e3-a9025f04ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a00f12-c5ca-42c9-8352-1a4851289a0f', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c44c477-2bf6-4177-beb6-3fa82b63088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-11a00f12-c5ca-42c9-8352-1a4851289a0f (11a00f12-c5ca-42c9-8352-1a4851289a0f): created successfully Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c44c477-2bf6-4177-beb6-3fa82b63088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (039cfca3-0d0a-4554-849c-a9c4b171eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-67035354-0b08-4317-baa3-fb54ddcd1019 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (bc01a61e-9b7f-4d1d-bf57-698078870ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f4ff39-92ca-482c-8460-f929954e0ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f4ff39-92ca-482c-8460-f929954e0ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378552941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fc75b2-9ca4-487a-80ff-4892de3a15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:44Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e0d88-99ab-46bc-9c93-92f0c2a86563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e0d88-99ab-46bc-9c93-92f0c2a86563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddf8a3a-611c-40e9-8bc6-7d4c14a6532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddf8a3a-611c-40e9-8bc6-7d4c14a6532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fc75b2-9ca4-487a-80ff-4892de3a15aa', 'volume_name': 'volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35a425-287b-4fb2-a8fb-00d2a52cf797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e35a425-287b-4fb2-a8fb-00d2a52cf797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f34b5-c212-4500-b76f-d732371b77a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:44 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume 78fc75b2-9ca4-487a-80ff-4892de3a15aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa', 'volume_size': 1} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378552941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fc75b2-9ca4-487a-80ff-4892de3a15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:44Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume 78fc75b2-9ca4-487a-80ff-4892de3a15aa {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:44 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:44 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa 1073741824 Jul 09 03:03:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (dfec84c2-4fea-48ca-b4f9-0a379bbabb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66113fc8-f6b8-46be-9472-7c0d7846be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66113fc8-f6b8-46be-9472-7c0d7846be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675199009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d494b-79bf-488a-b13d-72d0e673ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:45Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38ef539-3899-4469-a101-ba5b93b182f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38ef539-3899-4469-a101-ba5b93b182f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902307d6-5034-4d47-bf81-2204384f478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902307d6-5034-4d47-bf81-2204384f478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966d494b-79bf-488a-b13d-72d0e673ac5c', 'volume_name': 'volume-966d494b-79bf-488a-b13d-72d0e673ac5c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad40005a-c4a8-41e6-bfd2-a07713c691f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad40005a-c4a8-41e6-bfd2-a07713c691f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a20527-4a95-4ac4-b62f-004cefc993bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume 966d494b-79bf-488a-b13d-72d0e673ac5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966d494b-79bf-488a-b13d-72d0e673ac5c', 'volume_size': 1} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (8aec9298-7080-4886-88f0-db3a8f12fa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75f4d51-a5bc-47bb-93b5-4360facea624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75f4d51-a5bc-47bb-93b5-4360facea624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128208479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc6301-16e6-4bad-96b2-631a470aa50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34299ca-7b31-4e5a-9938-772274871cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34299ca-7b31-4e5a-9938-772274871cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dae976-0356-4ee9-8201-87ba992ab1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dae976-0356-4ee9-8201-87ba992ab1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebc6301-16e6-4bad-96b2-631a470aa50c', 'volume_name': 'volume-cebc6301-16e6-4bad-96b2-631a470aa50c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307c870f-7985-439b-8ee0-a0b4445514e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307c870f-7985-439b-8ee0-a0b4445514e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb543e3-e727-42a2-82de-f04601df2e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:45 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume cebc6301-16e6-4bad-96b2-631a470aa50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebc6301-16e6-4bad-96b2-631a470aa50c', 'volume_size': 1} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa 1073741824" returned: 0 in 1.351s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:45 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa Jul 09 03:03:45 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (bef08e46-99cf-4ec5-be14-3911aaae96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7780bbbf-ff3e-4439-b0df-cff3702ac647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7780bbbf-ff3e-4439-b0df-cff3702ac647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390271662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b77afba-6e8a-4752-8b6b-58c21ce6cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b77afba-6e8a-4752-8b6b-58c21ce6cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd6c33-6a57-45a6-841e-43af0e500eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd6c33-6a57-45a6-841e-43af0e500eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc', 'volume_name': 'volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677befb8-82d6-4bce-80e3-db0f580dc730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677befb8-82d6-4bce-80e3-db0f580dc730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129bf308-9ed6-4c01-9146-fccb65e4f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume 5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc', 'volume_size': 1} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (552eab88-fcdc-4eac-a67a-df4319beba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41855292-4e87-468b-b616-14114cdb885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41855292-4e87-468b-b616-14114cdb885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109173482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3942b-6b63-4bc2-ad1e-9262eca543cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0b3cf8-0039-4a24-a054-b0ac12e5c387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0b3cf8-0039-4a24-a054-b0ac12e5c387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02d074d-79e8-40ae-a0e3-489958dcd308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02d074d-79e8-40ae-a0e3-489958dcd308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd3942b-6b63-4bc2-ad1e-9262eca543cf', 'volume_name': 'volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92808db-0cc8-4af3-98a1-6ec78c90aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92808db-0cc8-4af3-98a1-6ec78c90aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aceab69-4b26-472c-aa25-0fa5a9204b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Volume 1bd3942b-6b63-4bc2-ad1e-9262eca543cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf', 'volume_size': 1} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:46 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa" returned: 0 in 0.853s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675199009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d494b-79bf-488a-b13d-72d0e673ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:45Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume 966d494b-79bf-488a-b13d-72d0e673ac5c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:46 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c 1073741824 Jul 09 03:03:46 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f34b5-c212-4500-b76f-d732371b77a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef3032-4567-4089-802d-f8ee092f1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa (78fc75b2-9ca4-487a-80ff-4892de3a15aa): created successfully Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef3032-4567-4089-802d-f8ee092f1027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (bc01a61e-9b7f-4d1d-bf57-698078870ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (a248aca4-85d0-4d2c-a261-5597f5649a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb43aecb-9774-4c4e-91e9-55555c6e0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-29e1e31a-3166-40ad-a972-8e0d5cfc4e99 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb43aecb-9774-4c4e-91e9-55555c6e0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946438477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7538f-2643-4584-8700-1b9e4ce03237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:47Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc0e57-29a5-46fd-9b2d-c25602a1ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc0e57-29a5-46fd-9b2d-c25602a1ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e79f51a-1622-41c6-9ee2-567233179ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e79f51a-1622-41c6-9ee2-567233179ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d7538f-2643-4584-8700-1b9e4ce03237', 'volume_name': 'volume-91d7538f-2643-4584-8700-1b9e4ce03237', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff50d287-fb9a-4f54-ac50-e7d147875153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff50d287-fb9a-4f54-ac50-e7d147875153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82bdab2-679f-4c9a-871d-3ab83dd2b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume 91d7538f-2643-4584-8700-1b9e4ce03237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d7538f-2643-4584-8700-1b9e4ce03237', 'volume_size': 1} Jul 09 03:03:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Flow 'volume_create_manager' (7a470519-e9c4-4620-8fb3-fc6357b8ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a33d8cb-6ee8-4a90-9ca4-b06da76b46cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a33d8cb-6ee8-4a90-9ca4-b06da76b46cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1332551970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08cd9acc-49f4-4ed5-a7ac-6b07be9384e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a8d59dfe504391bc74d83fc8f32b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ef275ad-7ebe-45e9-9586-a705bde35405,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:47Z,use_quota=True,user_id='bee4000102ec4278bf297665b7fc44f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7799829-d243-43c9-9409-fc58fc8a99d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7799829-d243-43c9-9409-fc58fc8a99d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7f059b-14aa-476c-bf6d-a07c70679984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7f059b-14aa-476c-bf6d-a07c70679984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08cd9acc-49f4-4ed5-a7ac-6b07be9384e5', 'volume_name': 'volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5', 'volume_size': 1, 'snapshot_id': '9ef275ad-7ebe-45e9-9586-a705bde35405'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cdbaf4-f691-4b88-9814-6a39dc8317b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cdbaf4-f691-4b88-9814-6a39dc8317b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131017d4-a50e-4ca4-91cd-98f4a0bdf568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:47 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Volume 08cd9acc-49f4-4ed5-a7ac-6b07be9384e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5', 'volume_size': 1, 'snapshot_id': '9ef275ad-7ebe-45e9-9586-a705bde35405'} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:47 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c 1073741824" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:47 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c Jul 09 03:03:47 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:48 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128208479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc6301-16e6-4bad-96b2-631a470aa50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume cebc6301-16e6-4bad-96b2-631a470aa50c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a20527-4a95-4ac4-b62f-004cefc993bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966d494b-79bf-488a-b13d-72d0e673ac5c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d035e0-e6ed-4b38-a5bf-e714580dd59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:48 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c 1073741824 Jul 09 03:03:48 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-966d494b-79bf-488a-b13d-72d0e673ac5c (966d494b-79bf-488a-b13d-72d0e673ac5c): created successfully Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d035e0-e6ed-4b38-a5bf-e714580dd59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (dfec84c2-4fea-48ca-b4f9-0a379bbabb79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-70e60e16-96d8-45c9-8d08-652c75505a00 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:49 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c 1073741824" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:49 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c Jul 09 03:03:49 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:49 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c" returned: 0 in 0.652s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390271662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume 5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:49 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:49 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc 1073741824 Jul 09 03:03:49 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb543e3-e727-42a2-82de-f04601df2e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebc6301-16e6-4bad-96b2-631a470aa50c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9adbf5-6c2f-4bdc-b755-e4eca208f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-cebc6301-16e6-4bad-96b2-631a470aa50c (cebc6301-16e6-4bad-96b2-631a470aa50c): created successfully Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9adbf5-6c2f-4bdc-b755-e4eca208f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (8aec9298-7080-4886-88f0-db3a8f12fa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a9f34846-95b1-44fc-b0bc-94828dbc2a86 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:50 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc 1073741824" returned: 0 in 0.841s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:50 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc Jul 09 03:03:50 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:51 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" returned: 0 in 0.616s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.738s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109173482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3942b-6b63-4bc2-ad1e-9262eca543cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:46Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Creating volume 1bd3942b-6b63-4bc2-ad1e-9262eca543cf {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:51 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129bf308-9ed6-4c01-9146-fccb65e4f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:51 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf 1073741824 Jul 09 03:03:51 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51919e89-9a8d-41d7-b526-5e55ea58161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc (5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc): created successfully Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51919e89-9a8d-41d7-b526-5e55ea58161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (bef08e46-99cf-4ec5-be14-3911aaae96df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b565804a-77e3-4aa0-85c6-9bba2bba2ef4 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:52 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf 1073741824" returned: 0 in 0.866s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:52 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf Jul 09 03:03:52 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:52 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" returned: 0 in 0.666s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.032s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946438477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7538f-2643-4584-8700-1b9e4ce03237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5c9ee8075c48edb9c301d9719c48a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:47Z,use_quota=True,user_id='34840228da2442fcbe36073ddde02d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Creating volume 91d7538f-2643-4584-8700-1b9e4ce03237 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:52 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aceab69-4b26-472c-aa25-0fa5a9204b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07361570-d864-4b98-ae06-ab4bfafa62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:52 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 1073741824 Jul 09 03:03:52 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Volume volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf (1bd3942b-6b63-4bc2-ad1e-9262eca543cf): created successfully Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07361570-d864-4b98-ae06-ab4bfafa62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (552eab88-fcdc-4eac-a67a-df4319beba6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3b821dd3-2fc0-4d29-baaa-48e9cab5b499 tempest-ProjectReaderTests-1039560793 None] Created volume successfully. Jul 09 03:03:53 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 1073741824" returned: 0 in 0.980s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-1bd3942b-6b63-4bc2-ad1e-9262eca543cf-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "cinder-1bd3942b-6b63-4bc2-ad1e-9262eca543cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:53 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 Jul 09 03:03:53 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-quobyte-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcda0e19-2ffe-46ba-810e-3198106c22a8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:54 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf Jul 09 03:03:54 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:54 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.421s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82bdab2-679f-4c9a-871d-3ab83dd2b610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d7538f-2643-4584-8700-1b9e4ce03237', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2d47c6-7722-45a5-91e0-f93810ecfd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Creating volume 08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 from snapshot 9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Volume volume-91d7538f-2643-4584-8700-1b9e4ce03237 (91d7538f-2643-4584-8700-1b9e4ce03237): created successfully Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2d47c6-7722-45a5-91e0-f93810ecfd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Flow 'volume_create_manager' (a248aca4-85d0-4d2c-a261-5597f5649a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] snapshot: 9ef275ad-7ebe-45e9-9586-a705bde35405, volume: 08cd9acc-49f4-4ed5-a7ac-6b07be9384e5, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:03:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8b022a4d-5583-4b30-b3b7-39e7b1177119 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created volume successfully. Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd23ad-10e6-437d-9e78-27a386aaeaab]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:54 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" returned: 0 in 0.959s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:54 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:03:54 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:54 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf Jul 09 03:03:54 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-91d7538f-2643-4584-8700-1b9e4ce03237-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-91d7538f-2643-4584-8700-1b9e4ce03237-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-91d7538f-2643-4584-8700-1b9e4ce03237" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-91d7538f-2643-4584-8700-1b9e4ce03237" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995809f-20d6-48d3-9b47-0647fd6fd7a8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:55 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:55 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 Jul 09 03:03:55 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-1bd3942b-6b63-4bc2-ad1e-9262eca543cf" released by "delete_volume" :: held 1.768s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Created reservations ['86edec77-7710-4fdf-a62f-f51be19f06c3', '269bbf18-26d6-4173-80c1-354b7bb81599', 'd0489494-c7f5-4718-9683-04d6d5231b25', '0002626b-8767-4827-8e20-9e8380d8ff86'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:55 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 1.222s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d929ba-6aec-490b-9108-dda96268d23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:03:56 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:03:56 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1192469-02d7-467e-a370-ab53b94d6737]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:56 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:03:56 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:56 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237" returned: 0 in 1.154s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:56 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237 Jul 09 03:03:56 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:57 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.046s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Deleted volume successfully. Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d7cd6718-e5c0-4ebd-a17e-06c7077240ac tempest-ProjectReaderTests-1039560793 None] Lock "cinder-1bd3942b-6b63-4bc2-ad1e-9262eca543cf-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (aee5d638-5e0f-492e-98bb-26ca0e8dc720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811d5b3f-8986-4ada-8d43-deb594045f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811d5b3f-8986-4ada-8d43-deb594045f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077526697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d23bb3d-9a3b-4d72-bca4-4e17990142c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:57Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5b317f-c246-4c3e-b45d-2bcf5812ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5b317f-c246-4c3e-b45d-2bcf5812ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117afe99-da4f-48e7-abf2-c850888f47fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117afe99-da4f-48e7-abf2-c850888f47fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d23bb3d-9a3b-4d72-bca4-4e17990142c7', 'volume_name': 'volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e0a360-a807-47fc-b038-456ff7f426c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e0a360-a807-47fc-b038-456ff7f426c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cf1af8-3697-4029-9344-999223218d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:03:57 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Volume 4d23bb3d-9a3b-4d72-bca4-4e17990142c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7', 'volume_size': 1} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:57 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 1.306s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:57 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 Jul 09 03:03:57 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:57 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-91d7538f-2643-4584-8700-1b9e4ce03237" returned: 0 in 0.953s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-91d7538f-2643-4584-8700-1b9e4ce03237" released by "delete_volume" :: held 2.182s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['dd0314d8-dbc4-4a7c-9621-f57756465322', 'b4354295-b01a-4eb6-8b74-1253a4d268d2', '2b265865-389a-4a4a-87dc-88ef49bff0b0', '0c9356b6-49fe-4aef-b3a5-4f8e3db04256'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:03:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:57 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:03:57 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:03:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d985d3-3c1d-458f-aaa4-593694d46bf0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:03:59 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.602s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:03:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:03:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c351554e-a395-4a42-8c0e-8ed132b1bc1f tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-91d7538f-2643-4584-8700-1b9e4ce03237-delete_volume" released by "delete_volume" :: held 4.133s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:03:59 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc Jul 09 03:03:59 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:01 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" returned: 0 in 1.895s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:01 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc Jul 09 03:04:01 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:03 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" returned: 0 in 2.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc" released by "delete_volume" :: held 4.754s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['2dc68bd2-4e0d-4c46-9067-db24bbdbd824', '50230555-9116-4d71-a32a-ebc4bf14b632', '471b947e-89b2-44c9-b81e-fe2e05bdeb43', 'd4658de1-eb4f-426a-86b8-61e083be5845'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:04 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" returned: 0 in 6.885s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:04 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:04 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[38321ce1-c612-48ff-8297-d085a7b4e01f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:04 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:04:04 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:04 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:04:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e5d37fc9-5418-4a26-b295-e55817f70d23 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-5aad0f1b-b08e-4952-aae4-8ae26e4b3dcc-delete_volume" released by "delete_volume" :: held 5.967s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-cebc6301-16e6-4bad-96b2-631a470aa50c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-cebc6301-16e6-4bad-96b2-631a470aa50c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-cebc6301-16e6-4bad-96b2-631a470aa50c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-cebc6301-16e6-4bad-96b2-631a470aa50c" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[627dabf8-5ca4-4b66-8279-fbb9bd0eb603]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:05 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c Jul 09 03:04:05 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:05 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 1.196s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:04:05 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Converted 1024.00 MB image at 148.71 MB/s Jul 09 03:04:05 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 is being set with open permissions: ugo+rw Jul 09 03:04:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:05 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 Jul 09 03:04:05 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:06 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c" returned: 0 in 0.974s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:06 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c Jul 09 03:04:06 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:06 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" released by "_copy_volume_from_snapshot" :: held 11.544s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" released by "_create_volume_from_snapshot" :: held 11.613s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.651s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.992s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077526697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d23bb3d-9a3b-4d72-bca4-4e17990142c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:03:57Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Creating volume 4d23bb3d-9a3b-4d72-bca4-4e17990142c7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:06 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:06 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 1073741824 Jul 09 03:04:06 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131017d4-a50e-4ca4-91cd-98f4a0bdf568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5', 'volume_size': 1, 'snapshot_id': '9ef275ad-7ebe-45e9-9586-a705bde35405'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66699809-bde7-4d9a-97cc-86433b511a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:06 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Volume volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 (08cd9acc-49f4-4ed5-a7ac-6b07be9384e5): created successfully Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66699809-bde7-4d9a-97cc-86433b511a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Flow 'volume_create_manager' (7a470519-e9c4-4620-8fb3-fc6357b8ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fba5edf3-62e1-4fd4-8c55-d48623303834 tempest-TestStampPattern-1785615215 None] Created volume successfully. Jul 09 03:04:06 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cebc6301-16e6-4bad-96b2-631a470aa50c" returned: 0 in 0.827s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-cebc6301-16e6-4bad-96b2-631a470aa50c" released by "delete_volume" :: held 1.860s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['8cf52732-4ff8-4691-9e3b-24cb05244528', 'c9078255-9460-460a-a03d-9c9dfee0c375', '8292b87e-a5e5-4b6d-bb0c-acd36fb6a267', 'fd6d6dd6-7690-4723-8bbd-5378acf14aac'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:07 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:07 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-966d494b-79bf-488a-b13d-72d0e673ac5c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-966d494b-79bf-488a-b13d-72d0e673ac5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:07 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 1073741824" returned: 0 in 1.109s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-966d494b-79bf-488a-b13d-72d0e673ac5c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-966d494b-79bf-488a-b13d-72d0e673ac5c" acquired by "delete_volume" :: waited 0.068s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:07 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 Jul 09 03:04:07 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d9e3e-c821-472a-a168-6d6a2ed96379]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:07 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c Jul 09 03:04:07 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:07 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:07 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:07 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b1360986-339b-4fb8-85cb-f81409375175 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-cebc6301-16e6-4bad-96b2-631a470aa50c-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:08 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" returned: 0 in 0.944s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cf1af8-3697-4029-9344-999223218d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad81c39-954e-4037-825c-6c34665e9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:08 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Volume volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 (4d23bb3d-9a3b-4d72-bca4-4e17990142c7): created successfully Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad81c39-954e-4037-825c-6c34665e9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (aee5d638-5e0f-492e-98bb-26ca0e8dc720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1f2ac16a-d8b3-4d16-95a2-5d74e9294896 tempest-ProjectReaderTests-1039560793 None] Created volume successfully. Jul 09 03:04:08 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c" returned: 0 in 1.158s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:08 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c Jul 09 03:04:08 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:09 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-966d494b-79bf-488a-b13d-72d0e673ac5c" returned: 0 in 0.635s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-966d494b-79bf-488a-b13d-72d0e673ac5c" released by "delete_volume" :: held 1.861s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['1e295173-ae26-4a94-a0a9-87c101440f2b', 'd9730f97-ee01-4ff4-9030-5ff6e2ce1786', '8e21c9b9-bb00-406b-8c45-8ae64ed4933c', '9eb1221a-18cf-4c37-ad4a-cda46b43cffe'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:09 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:09 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-4d23bb3d-9a3b-4d72-bca4-4e17990142c7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-78fc75b2-9ca4-487a-80ff-4892de3a15aa-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-4d23bb3d-9a3b-4d72-bca4-4e17990142c7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-78fc75b2-9ca4-487a-80ff-4892de3a15aa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-quobyte-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-78fc75b2-9ca4-487a-80ff-4892de3a15aa" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-78fc75b2-9ca4-487a-80ff-4892de3a15aa" acquired by "delete_volume" :: waited 0.045s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[01113929-a7ab-478c-a65b-6146516c8150]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01782b-7c62-459a-9592-e9656bdb24ee]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:10 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa Jul 09 03:04:10 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:10 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 Jul 09 03:04:10 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:10 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.028s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bec1a18b-f503-4d46-b0c4-310b648cfe04 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-966d494b-79bf-488a-b13d-72d0e673ac5c-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:10 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa" returned: 0 in 0.816s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:10 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa Jul 09 03:04:10 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:10 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" returned: 0 in 0.976s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:10 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7 Jul 09 03:04:10 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:11 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-78fc75b2-9ca4-487a-80ff-4892de3a15aa" returned: 0 in 0.636s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-78fc75b2-9ca4-487a-80ff-4892de3a15aa" released by "delete_volume" :: held 1.534s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['aef90972-29ff-4225-ae30-1e765d54235b', '05c4bd34-1eaa-4191-be83-aad64251fba7', 'cdd1e3a2-1fbe-4145-be8a-70492e982866', '40056ca0-734c-4c3d-933e-f90dfeea0f4f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:11 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" returned: 0 in 0.626s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-4d23bb3d-9a3b-4d72-bca4-4e17990142c7" released by "delete_volume" :: held 1.707s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:11 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:11 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Created reservations ['13ce627d-f8ef-4f78-9277-76adc2a882f3', 'a5cb323b-84cf-4064-a6c0-ead211dee812', '8c45a138-ee5c-41fa-b4e7-7bb09721d114', 'dacfc2f9-4e1d-412d-9c41-544531b598fe'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:11 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:11 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-11a00f12-c5ca-42c9-8352-1a4851289a0f-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-11a00f12-c5ca-42c9-8352-1a4851289a0f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "cinder-quobyte-11a00f12-c5ca-42c9-8352-1a4851289a0f" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-11a00f12-c5ca-42c9-8352-1a4851289a0f" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2317daf-bf3e-4432-94ca-628007ec3d26]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:12 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.932s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:12 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f Jul 09 03:04:12 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-03dffe20-9b1f-4e7e-8c9c-1e2e7a3c90c9 tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-78fc75b2-9ca4-487a-80ff-4892de3a15aa-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:12 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.982s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Deleted volume successfully. Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-771f7daf-c023-4776-992f-e299f8c49667 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-4d23bb3d-9a3b-4d72-bca4-4e17990142c7-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (19862c84-6661-4834-bf4d-33fdaf37ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f703832f-97aa-4539-8e12-2aabd43d214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f703832f-97aa-4539-8e12-2aabd43d214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042043820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867e81ae-ad19-4b06-bf7e-43a2319fb701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:13Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e6fba-d15f-43df-85a9-73bb82b8897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e6fba-d15f-43df-85a9-73bb82b8897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72f839c-1296-4ad3-8b69-04ce3181fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72f839c-1296-4ad3-8b69-04ce3181fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867e81ae-ad19-4b06-bf7e-43a2319fb701', 'volume_name': 'volume-867e81ae-ad19-4b06-bf7e-43a2319fb701', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f070dea-8c85-4f51-96c5-a88c90cb6472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f070dea-8c85-4f51-96c5-a88c90cb6472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d37502-345f-467a-8ef4-af0f47e4ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Volume 867e81ae-ad19-4b06-bf7e-43a2319fb701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867e81ae-ad19-4b06-bf7e-43a2319fb701', 'volume_size': 1} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042043820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867e81ae-ad19-4b06-bf7e-43a2319fb701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:13Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Creating volume 867e81ae-ad19-4b06-bf7e-43a2319fb701 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:12 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:12 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 1073741824 Jul 09 03:04:12 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:13 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f" returned: 0 in 0.916s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:13 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f Jul 09 03:04:13 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:13 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 1073741824" returned: 0 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:13 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 Jul 09 03:04:13 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:13 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-11a00f12-c5ca-42c9-8352-1a4851289a0f" returned: 0 in 0.638s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-quobyte-11a00f12-c5ca-42c9-8352-1a4851289a0f" released by "delete_volume" :: held 1.616s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:13 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Created reservations ['732a2a53-a7e2-47cb-a5a2-427a94c21cd3', '08f93a38-30a8-4ef3-97d0-3949ea11c0f0', '7a092c21-f4a0-4aa9-8646-5d6c967a8eb9', 'd7e1f160-c0b8-435c-81b5-caf4a43ff3cb'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:14 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:14 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:14 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701" returned: 0 in 0.651s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d37502-345f-467a-8ef4-af0f47e4ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867e81ae-ad19-4b06-bf7e-43a2319fb701', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a29541-4a29-414f-9394-d13b87e7ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:14 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Volume volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 (867e81ae-ad19-4b06-bf7e-43a2319fb701): created successfully Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a29541-4a29-414f-9394-d13b87e7ac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (19862c84-6661-4834-bf4d-33fdaf37ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7a6ebe30-f389-4d70-8958-654545bc6b9d tempest-ProjectReaderTests-1039560793 None] Created volume successfully. Jul 09 03:04:14 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.671s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Deleted volume successfully. Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-cbc05090-6929-4b97-ae5b-ecaa2030794c tempest-CreateVolumesFromSourceVolumeTest-141933654 None] Lock "cinder-11a00f12-c5ca-42c9-8352-1a4851289a0f-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-867e81ae-ad19-4b06-bf7e-43a2319fb701-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "cinder-867e81ae-ad19-4b06-bf7e-43a2319fb701-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-quobyte-867e81ae-ad19-4b06-bf7e-43a2319fb701" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-867e81ae-ad19-4b06-bf7e-43a2319fb701" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[887aac7f-5839-4cee-94bf-543014c74b53]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:15 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 Jul 09 03:04:15 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:15 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701" returned: 0 in 0.798s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:15 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701 Jul 09 03:04:15 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:16 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-867e81ae-ad19-4b06-bf7e-43a2319fb701" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-867e81ae-ad19-4b06-bf7e-43a2319fb701" released by "delete_volume" :: held 1.482s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Created reservations ['3d076038-8426-4823-ac84-453958f8bae8', 'ee6c5252-81d6-4622-b008-ec43c6ea65b0', '4d2273b7-c83a-41ef-8c67-50a4429846f6', '3e9e4562-5630-43d4-9450-f0a667efacc3'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:16 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:16 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:17 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.656s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Deleted volume successfully. Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4302130e-bc7c-4635-9ede-02b02a98863c tempest-ProjectReaderTests-1039560793 None] Lock "cinder-867e81ae-ad19-4b06-bf7e-43a2319fb701-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Flow 'volume_create_manager' (60c6dac5-c06f-4af3-aed9-2332b3ac3a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f63c4af-0713-411a-a5f9-4a11cd92d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f63c4af-0713-411a-a5f9-4a11cd92d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-924998575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d99a9e-47ea-43a3-ba8e-7965ff93cc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1e26f3f9cb410cb1440795d7f2ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:17Z,use_quota=True,user_id='bad89fe6cf764e9588a5fd02bbc728a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7e3fbf-346f-44e0-a07d-565a2e6a4478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7e3fbf-346f-44e0-a07d-565a2e6a4478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5752ecb4-3649-4ecb-a526-f711f01db5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5752ecb4-3649-4ecb-a526-f711f01db5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d99a9e-47ea-43a3-ba8e-7965ff93cc02', 'volume_name': 'volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2b2ce3-fa0d-40cb-82ef-9ad6cbc41fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2b2ce3-fa0d-40cb-82ef-9ad6cbc41fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c39e028-d99c-44f4-ae04-8e2de91ae0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Volume 79d99a9e-47ea-43a3-ba8e-7965ff93cc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02', 'volume_size': 1} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-924998575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d99a9e-47ea-43a3-ba8e-7965ff93cc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1e26f3f9cb410cb1440795d7f2ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:17Z,use_quota=True,user_id='bad89fe6cf764e9588a5fd02bbc728a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Creating volume 79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:17 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:17 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 1073741824 Jul 09 03:04:17 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (17bb75d5-6ac6-4512-8ec9-c1169890cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1978268-371b-43bf-91ca-a31d02fc0459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1978268-371b-43bf-91ca-a31d02fc0459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049367788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47452f6-3d08-4b1f-947d-e5f32621cb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:18Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3fd6ba-be42-41be-8ae6-9f333528a73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3fd6ba-be42-41be-8ae6-9f333528a73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a47d14-13c6-4c3d-84bd-f351a8cc7e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a47d14-13c6-4c3d-84bd-f351a8cc7e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47452f6-3d08-4b1f-947d-e5f32621cb19', 'volume_name': 'volume-d47452f6-3d08-4b1f-947d-e5f32621cb19', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c4126a-f88f-4256-9918-48bb71255f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c4126a-f88f-4256-9918-48bb71255f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8520173-d5f3-4478-909e-d966e050c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Volume d47452f6-3d08-4b1f-947d-e5f32621cb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47452f6-3d08-4b1f-947d-e5f32621cb19', 'volume_size': 1} Jul 09 03:04:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:18 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 1073741824" returned: 0 in 0.806s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:18 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=95,cinder:INSERT=25,cinder:UPDATE=116,cinder:DELETE=11 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:04:18 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=86,cinder:UPDATE=128,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:04:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:18 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:18 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:19 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.653s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049367788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47452f6-3d08-4b1f-947d-e5f32621cb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c318935fc6434ee89b3fff8ab2933e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:18Z,use_quota=True,user_id='f9014b56e7174d0387e36041f334cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Creating volume d47452f6-3d08-4b1f-947d-e5f32621cb19 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:19 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c39e028-d99c-44f4-ae04-8e2de91ae0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:19 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 1073741824 Jul 09 03:04:19 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608f2c3-8503-4946-b01f-f554426ad1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:19 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Volume volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 (79d99a9e-47ea-43a3-ba8e-7965ff93cc02): created successfully Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608f2c3-8503-4946-b01f-f554426ad1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Flow 'volume_create_manager' (60c6dac5-c06f-4af3-aed9-2332b3ac3a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-794f90d0-2e0e-40ac-bebb-a6e0cc1ea75f tempest-VolumeDependencyTests-503469886 None] Created volume successfully. Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:19 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 1073741824" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:19 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 Jul 09 03:04:19 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:20 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19" returned: 0 in 0.631s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8520173-d5f3-4478-909e-d966e050c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47452f6-3d08-4b1f-947d-e5f32621cb19', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aedc385-0990-4964-99bf-4650e2d88314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Creating offline snapshot 7d2175ed-6c4b-456a-b8f0-f5c772430680 of volume 79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Volume volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 (d47452f6-3d08-4b1f-947d-e5f32621cb19): created successfully Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aedc385-0990-4964-99bf-4650e2d88314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Flow 'volume_create_manager' (17bb75d5-6ac6-4512-8ec9-c1169890cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f6fd7b-cace-407c-804e-91d71a98faf1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5678415d-1098-4abf-895d-1ad32cbafe6f tempest-ProjectReaderTests-1039560793 None] Created volume successfully. Jul 09 03:04:20 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:20 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-d47452f6-3d08-4b1f-947d-e5f32621cb19-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-d47452f6-3d08-4b1f-947d-e5f32621cb19-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "cinder-quobyte-d47452f6-3d08-4b1f-947d-e5f32621cb19" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-d47452f6-3d08-4b1f-947d-e5f32621cb19" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b81406-b00d-4651-a483-1f9e8798ae8c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:21 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 Jul 09 03:04:21 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:21 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:21 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 1G Jul 09 03:04:21 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:21 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:21 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19 Jul 09 03:04:21 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:22 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 1G" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:22 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:22 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:22 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d47452f6-3d08-4b1f-947d-e5f32621cb19" returned: 0 in 0.649s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-quobyte-d47452f6-3d08-4b1f-947d-e5f32621cb19" released by "delete_volume" :: held 1.494s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Created reservations ['b146472b-a1c1-4730-8b67-d25ed4494f47', 'bb642416-ecb2-4483-92f4-0cfc69a1c510', 'af9da6ac-044a-4cf2-9279-1c799369d90e', 'b6a76c99-401a-48b7-9ed9-12cb96ab2516'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:22 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:22 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:22 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.686s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:22 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 is being set with open permissions: ugo+rw Jul 09 03:04:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:22 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:22 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:23 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.673s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Deleted volume successfully. Jul 09 03:04:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b4b77e6f-f8af-43a0-bf6f-9140b93fdc70 tempest-ProjectReaderTests-1039560793 None] Lock "cinder-d47452f6-3d08-4b1f-947d-e5f32621cb19-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:23 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.639s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:23 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info Jul 09 03:04:23 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:24 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info" returned: 0 in 0.660s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:24 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info is being set with open permissions: ugo+rw Jul 09 03:04:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:24 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info Jul 09 03:04:24 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:24 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.info" returned: 0 in 0.679s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:24 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8f60573e-beab-4459-8f73-ef820c6ade65 tempest-VolumeDependencyTests-503469886 None] Create snapshot completed successfully Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Flow 'volume_create_manager' (c78d6937-bf0d-4d95-8c87-739442694829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be4f9a3-8acc-48b3-a6fc-78bdfad21e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be4f9a3-8acc-48b3-a6fc-78bdfad21e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-400076961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e106919-3592-4b92-8561-3b2039d27f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1e26f3f9cb410cb1440795d7f2ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d2175ed-6c4b-456a-b8f0-f5c772430680,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:26Z,use_quota=True,user_id='bad89fe6cf764e9588a5fd02bbc728a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9745ea9a-150d-43ea-9b38-434640f1f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9745ea9a-150d-43ea-9b38-434640f1f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6983365-8326-4356-aed7-3c4a5f2e6776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6983365-8326-4356-aed7-3c4a5f2e6776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e106919-3592-4b92-8561-3b2039d27f03', 'volume_name': 'volume-1e106919-3592-4b92-8561-3b2039d27f03', 'volume_size': 1, 'snapshot_id': '7d2175ed-6c4b-456a-b8f0-f5c772430680'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65d5c41-d362-4ba4-af12-be92b821fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65d5c41-d362-4ba4-af12-be92b821fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7320e81-8715-4186-b48f-4a54778aa4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:26 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Volume 1e106919-3592-4b92-8561-3b2039d27f03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e106919-3592-4b92-8561-3b2039d27f03', 'volume_size': 1, 'snapshot_id': '7d2175ed-6c4b-456a-b8f0-f5c772430680'} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680-1e106919-3592-4b92-8561-3b2039d27f03" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680-1e106919-3592-4b92-8561-3b2039d27f03" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Creating volume 1e106919-3592-4b92-8561-3b2039d27f03 from snapshot 7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] snapshot: 7d2175ed-6c4b-456a-b8f0-f5c772430680, volume: 1e106919-3592-4b92-8561-3b2039d27f03, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623f74c-dc0c-4c01-bda6-6780cadd0043]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:26 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:26 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:27 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432a970-f47c-4691-b770-b17672f004ed]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:27 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:27 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:27 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:27 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:28 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.779s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:28 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 Jul 09 03:04:28 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:28 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.651s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:04:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:04:32 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03" returned: 0 in 4.440s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[898daace-4de5-4be5-8cef-7bda7b7b7550]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:32 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:32 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:33 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.918s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:33 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:04:33 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Converted 1024.00 MB image at 230.60 MB/s Jul 09 03:04:33 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 is being set with open permissions: ugo+rw Jul 09 03:04:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:33 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 Jul 09 03:04:33 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:34 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03" returned: 0 in 0.656s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" released by "_copy_volume_from_snapshot" :: held 7.690s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680-1e106919-3592-4b92-8561-3b2039d27f03" released by "_create_volume_from_snapshot" :: held 7.720s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.737s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7320e81-8715-4186-b48f-4a54778aa4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e106919-3592-4b92-8561-3b2039d27f03', 'volume_size': 1, 'snapshot_id': '7d2175ed-6c4b-456a-b8f0-f5c772430680'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d7734-6f2b-4832-999e-66417f0390bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:34 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Volume volume-1e106919-3592-4b92-8561-3b2039d27f03 (1e106919-3592-4b92-8561-3b2039d27f03): created successfully Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d7734-6f2b-4832-999e-66417f0390bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Flow 'volume_create_manager' (c78d6937-bf0d-4d95-8c87-739442694829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6bc7d3dd-a1df-436a-bafe-37b10a7439ca tempest-VolumeDependencyTests-503469886 None] Created volume successfully. Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0d334-89de-4b47-9ddd-dca7cbc8473a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:34 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 Jul 09 03:04:34 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-7d2175ed-6c4b-456a-b8f0-f5c772430680-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-7d2175ed-6c4b-456a-b8f0-f5c772430680-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Deleting offline snapshot 7d2175ed-6c4b-456a-b8f0-f5c772430680 of volume 79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] snapshot_file for this snap is: volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[23808dc9-a0bf-4e35-a7af-a385b4dc7112]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:35 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9', 'name': 'volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66a3bf37-292b-4975-9c4b-0ab79879802a', 'enforce_multipath': True} {{(pid=87156) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 03:04:35 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:35 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-4e95e5c9-0605-49a2-ad92-5d7120e45f48 req-01a58c0d-bd56-4c1e-bf9b-084160ca1ccd tempest-TestStampPattern-1785615215 None] attachment_update completed successfully. Jul 09 03:04:35 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.737s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace24da-7a5a-40ff-9f68-b29d05176517]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:36 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:36 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:36 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.756s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:36 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:36 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:37 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.712s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:37 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680 Jul 09 03:04:37 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:38 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02.7d2175ed-6c4b-456a-b8f0-f5c772430680" returned: 0 in 0.608s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-7d2175ed-6c4b-456a-b8f0-f5c772430680" released by "_delete_snapshot" :: held 2.916s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" released by "delete_snapshot" :: held 2.944s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Created reservations ['0263b1f6-2c48-4257-9dc9-8643609dc067', '19d47a4b-9750-401a-ac38-31acaf697f69', '05d87a49-d2ec-43b8-b492-976bad415737', '9c4d9d24-3f33-4cb1-948c-c6aa6ec19c3b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Delete snapshot completed successfully. Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a189b38c-0197-415f-8954-626c0703676a tempest-VolumeDependencyTests-503469886 None] Lock "cinder-7d2175ed-6c4b-456a-b8f0-f5c772430680-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-79d99a9e-47ea-43a3-ba8e-7965ff93cc02-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-79d99a9e-47ea-43a3-ba8e-7965ff93cc02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998ecce-303b-4769-9247-4eda4b434df5]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:38 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:38 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:39 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:39 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02 Jul 09 03:04:39 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:39 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" returned: 0 in 0.627s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-79d99a9e-47ea-43a3-ba8e-7965ff93cc02" released by "delete_volume" :: held 1.452s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:39 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Created reservations ['c2051e7c-e413-4ecd-a2ff-4007aefe1cc3', 'dc2595bf-702b-4516-b1df-11c1ac83150f', '05fe4ce5-c266-4f7c-a53b-a6fa4976df55', 'c2c65a89-4e0b-4ebb-838e-974d713fdbbd'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:40 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:40 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-1e106919-3592-4b92-8561-3b2039d27f03-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-1e106919-3592-4b92-8561-3b2039d27f03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[53247a06-cd70-4d41-bf99-2f5247113af8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:40 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.732s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Deleted volume successfully. Jul 09 03:04:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-061ec251-7705-45a4-8f6f-0cb9af8f8599 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-79d99a9e-47ea-43a3-ba8e-7965ff93cc02-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:40 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 Jul 09 03:04:40 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:41 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03" returned: 0 in 0.783s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:41 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03 Jul 09 03:04:41 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [req-e44a3d54-84f5-45ae-b0f7-2d43f8e37c5f req-147a2b1b-620a-428e-a9ad-fdff2a3b2464 tempest-TestStampPattern-1785615215 None] Terminate volume connection completed successfully. Jul 09 03:04:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [req-e44a3d54-84f5-45ae-b0f7-2d43f8e37c5f req-147a2b1b-620a-428e-a9ad-fdff2a3b2464 tempest-TestStampPattern-1785615215 None] Deleting attachment 66a3bf37-292b-4975-9c4b-0ab79879802a. {{(pid=87156) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 03:04:42 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-1e106919-3592-4b92-8561-3b2039d27f03" returned: 0 in 0.660s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-quobyte-1e106919-3592-4b92-8561-3b2039d27f03" released by "delete_volume" :: held 1.487s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Created reservations ['157bc265-e4d5-453c-b17a-c634e559a4ce', '7c7ff286-5893-4c92-b307-5b3277e9187c', '83a46959-7cb3-403a-8756-68b56e411cac', 'c0ba5398-eed2-4333-9682-4becd5dd84ae'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:42 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:42 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:42 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.671s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:42 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:42 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Deleted volume successfully. Jul 09 03:04:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b46e6bcb-04ec-4235-bc89-e2c27a910537 tempest-VolumeDependencyTests-503469886 None] Lock "cinder-1e106919-3592-4b92-8561-3b2039d27f03-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Flow 'volume_create_manager' (94c9b631-7a0e-4bdf-a1d5-2175ecc82444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054438e7-7147-4249-99bf-3fcff97eb0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054438e7-7147-4249-99bf-3fcff97eb0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9007297f-4f76-4313-b81c-caad99c91d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5f7825ffbc4ed1848c7036a2eac894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:46Z,use_quota=True,user_id='2de13004bb7a473a806d17655a9e7a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb606bf-4cc6-41c8-9783-7c0ddd9ee52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb606bf-4cc6-41c8-9783-7c0ddd9ee52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a87db5c-7ea8-4baa-8ae0-4f9556cc77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a87db5c-7ea8-4baa-8ae0-4f9556cc77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9007297f-4f76-4313-b81c-caad99c91d44', 'volume_name': 'volume-9007297f-4f76-4313-b81c-caad99c91d44', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282eea6b-8e39-4d4e-bdc0-9add32cd8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282eea6b-8e39-4d4e-bdc0-9add32cd8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371aa2a7-26d8-42f3-9cd6-7b31bf0d6c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:46 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Volume 9007297f-4f76-4313-b81c-caad99c91d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9007297f-4f76-4313-b81c-caad99c91d44', 'volume_size': 1} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9007297f-4f76-4313-b81c-caad99c91d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5f7825ffbc4ed1848c7036a2eac894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:46Z,use_quota=True,user_id='2de13004bb7a473a806d17655a9e7a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Creating volume 9007297f-4f76-4313-b81c-caad99c91d44 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:46 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:46 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 1073741824 Jul 09 03:04:46 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:47 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 1073741824" returned: 0 in 0.938s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:47 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 Jul 09 03:04:47 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:48 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371aa2a7-26d8-42f3-9cd6-7b31bf0d6c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9007297f-4f76-4313-b81c-caad99c91d44', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5360c347-ecc6-4e91-bd26-7403bdd120f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Volume volume-9007297f-4f76-4313-b81c-caad99c91d44 (9007297f-4f76-4313-b81c-caad99c91d44): created successfully Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5360c347-ecc6-4e91-bd26-7403bdd120f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Flow 'volume_create_manager' (94c9b631-7a0e-4bdf-a1d5-2175ecc82444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-268af4ff-de7b-46bb-b27c-c48945ef81e6 tempest-CinderUnicodeTest-1707161571 None] Created volume successfully. Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Flow 'volume_create_manager' (ba7f51a6-77f3-4227-b561-5e082ff34534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7fe32-506e-4e43-b908-6c8b1dac5b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7fe32-506e-4e43-b908-6c8b1dac5b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1049320849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71f8c28-56e7-4f4e-9c20-9ef778016f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5f7825ffbc4ed1848c7036a2eac894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:49Z,use_quota=True,user_id='2de13004bb7a473a806d17655a9e7a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9027c8ce-44d6-4d34-af4d-38ec4ecbab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9027c8ce-44d6-4d34-af4d-38ec4ecbab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1008e1-ab01-40d6-8d90-caf4f7e45e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1008e1-ab01-40d6-8d90-caf4f7e45e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71f8c28-56e7-4f4e-9c20-9ef778016f52', 'volume_name': 'volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b406c3-15c7-41f5-8284-cb9e05ad1de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b406c3-15c7-41f5-8284-cb9e05ad1de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8939c491-eeb6-482d-a1f1-fa10ceae1043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Volume f71f8c28-56e7-4f4e-9c20-9ef778016f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52', 'volume_size': 1} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:04:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1049320849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71f8c28-56e7-4f4e-9c20-9ef778016f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5f7825ffbc4ed1848c7036a2eac894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:04:49Z,use_quota=True,user_id='2de13004bb7a473a806d17655a9e7a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Creating volume f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:04:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:04:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:48 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 1073741824 Jul 09 03:04:48 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:49 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 1073741824" returned: 0 in 0.791s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:49 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 Jul 09 03:04:49 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:50 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52" returned: 0 in 0.628s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8939c491-eeb6-482d-a1f1-fa10ceae1043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6bbed0-c82e-4afc-be46-91ff9a33cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:04:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Volume volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 (f71f8c28-56e7-4f4e-9c20-9ef778016f52): created successfully Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6bbed0-c82e-4afc-be46-91ff9a33cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:04:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Flow 'volume_create_manager' (ba7f51a6-77f3-4227-b561-5e082ff34534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:04:50 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-de34d28e-d01d-4365-a620-f4a3930689cd tempest-CinderUnicodeTest-1707161571 None] Created volume successfully. Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Creating offline snapshot 6794de99-97a0-4abc-a05b-a7000e3d903d of volume f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4580085-c0f9-48a1-b77a-5bff4e8aaab4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "cinder-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:51 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 Jul 09 03:04:51 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00add6-efc9-4454-af08-082288358041]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:51 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 Jul 09 03:04:51 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:51 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52" returned: 0 in 0.790s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:51 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d 1G Jul 09 03:04:51 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:52 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" returned: 0 in 0.765s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:52 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5 Jul 09 03:04:52 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:52 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d 1G" returned: 0 in 0.792s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:52 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d Jul 09 03:04:52 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:52 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5" released by "delete_volume" :: held 1.538s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:52 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Created reservations ['d6e914e3-a2dc-43f3-b69a-1154ef0d842a', 'fa86b8b2-ba4b-45ec-b431-81fe84de3b56', 'bf911aa3-fd94-4b54-b598-2dc546fc2a05', '7f96c506-fcfa-43c3-b837-f3f428880819'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:53 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:04:53 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:53 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d" returned: 0 in 0.737s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:53 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d is being set with open permissions: ugo+rw Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:53 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d Jul 09 03:04:53 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:53 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.673s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:04:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Deleted volume successfully. Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f318b9b3-5b8c-437a-8aa2-9f44f0980d3b tempest-TestStampPattern-1785615215 None] Lock "cinder-08cd9acc-49f4-4ed5-a7ac-6b07be9384e5-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-9ef275ad-7ebe-45e9-9586-a705bde35405-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-9ef275ad-7ebe-45e9-9586-a705bde35405-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Deleting offline snapshot 9ef275ad-7ebe-45e9-9586-a705bde35405 of volume 24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] snapshot_file for this snap is: volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac12e56-6e44-4e3c-ae65-d75d1cb317ea]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:54 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:04:54 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:54 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:54 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info Jul 09 03:04:54 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:54 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d929ba-6aec-490b-9108-dda96268d23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[62562c45-e8b8-4f18-abe0-67112476f4fe]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:54 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:04:54 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:54 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info" returned: 0 in 0.661s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:54 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info is being set with open permissions: ugo+rw Jul 09 03:04:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:54 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info Jul 09 03:04:54 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:55 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:55 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:04:55 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:55 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.info" returned: 0 in 0.641s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.425s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:04:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9e13069c-84cf-448c-b21b-b01869b8c011 tempest-CinderUnicodeTest-1707161571 None] Create snapshot completed successfully Jul 09 03:04:56 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:56 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405 Jul 09 03:04:56 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-6794de99-97a0-4abc-a05b-a7000e3d903d-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-6794de99-97a0-4abc-a05b-a7000e3d903d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-quobyte-6794de99-97a0-4abc-a05b-a7000e3d903d" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-6794de99-97a0-4abc-a05b-a7000e3d903d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Deleting offline snapshot 6794de99-97a0-4abc-a05b-a7000e3d903d of volume f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] snapshot_file for this snap is: volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a5622c-e060-46cb-84eb-2f39b58c48ff]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:56 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d Jul 09 03:04:56 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:56 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b.9ef275ad-7ebe-45e9-9586-a705bde35405" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-9ef275ad-7ebe-45e9-9586-a705bde35405" released by "_delete_snapshot" :: held 2.942s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" released by "delete_snapshot" :: held 2.965s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Created reservations ['23b97815-02d6-41ae-a394-91e0f407fae8', 'f5c1b056-97b6-4f47-ae3a-25bcb6335729', '12eaa605-0d99-41cf-9f52-1fbe55ec8cec', '293ab502-287f-4aab-8496-e3883747fec3'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Delete snapshot completed successfully. Jul 09 03:04:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-571be389-936f-4137-93f1-c5ccfc481ae9 tempest-TestStampPattern-1785615215 None] Lock "cinder-9ef275ad-7ebe-45e9-9586-a705bde35405-delete_snapshot" released by "delete_snapshot" :: held 3.118s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:57 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:04:57 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baba1d-98cb-427c-9af0-cce8f515ce0a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:04:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:57 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 Jul 09 03:04:57 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:58 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52" returned: 0 in 0.886s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:58 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d Jul 09 03:04:58 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:58 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:04:58 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d Jul 09 03:04:58 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:04:59 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 09 03:04:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52.6794de99-97a0-4abc-a05b-a7000e3d903d" returned: 0 in 0.680s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:04:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-6794de99-97a0-4abc-a05b-a7000e3d903d" released by "_delete_snapshot" :: held 3.228s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" released by "delete_snapshot" :: held 3.248s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:04:59 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Created reservations ['46e72d0d-5864-4450-928e-0031345f749e', '8ec755be-bc31-4b2e-bed9-74d2efbe07cf', '02c6b201-d589-4396-b405-3019312e4d7e', '471f89ce-b43e-4ed8-8910-5526b8e93596'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:04:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Delete snapshot completed successfully. Jul 09 03:04:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-62ef8f7c-57d6-4ac3-8134-94718d0b1f95 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-6794de99-97a0-4abc-a05b-a7000e3d903d-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-f71f8c28-56e7-4f4e-9c20-9ef778016f52-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-f71f8c28-56e7-4f4e-9c20-9ef778016f52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" acquired by "delete_volume" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad1da5-611b-491b-850a-a3a2536f4108]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:00 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 Jul 09 03:05:00 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:01 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:01 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52 Jul 09 03:05:01 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:02 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f71f8c28-56e7-4f4e-9c20-9ef778016f52" returned: 0 in 0.695s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-f71f8c28-56e7-4f4e-9c20-9ef778016f52" released by "delete_volume" :: held 1.623s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Created reservations ['64574dea-e900-4028-9b3c-c19538e656ca', '8f9b4299-79f5-45e1-9574-32a7fe1fb30f', '3d2c580d-65f0-4a5d-a3fb-6a53368f7712', 'd2737e76-b1b5-44f9-aecf-222ff97bde01'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:02 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:05:02 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-9007297f-4f76-4313-b81c-caad99c91d44-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-9007297f-4f76-4313-b81c-caad99c91d44-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "cinder-quobyte-9007297f-4f76-4313-b81c-caad99c91d44" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-9007297f-4f76-4313-b81c-caad99c91d44" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a775a824-6a8f-4b7c-9b64-9dcc3a58c7f4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:03 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 Jul 09 03:05:03 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:03 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Deleted volume successfully. Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-21580f85-b7fc-4229-9237-1e7494d34f3b tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-f71f8c28-56e7-4f4e-9c20-9ef778016f52-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:03 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:03 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44 Jul 09 03:05:03 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-24d929ba-6aec-490b-9108-dda96268d23b-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "cinder-24d929ba-6aec-490b-9108-dda96268d23b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Acquiring lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db5ed0-7574-427f-ba95-b1c814b53e61]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:04 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9007297f-4f76-4313-b81c-caad99c91d44" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:04 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:05:04 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-quobyte-9007297f-4f76-4313-b81c-caad99c91d44" released by "delete_volume" :: held 1.492s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Created reservations ['1aff1463-cf67-4f61-a209-a0eeba44d24c', '107c6914-1fb9-4a72-8b61-547a1bfc71bd', '580102d2-a5e6-4523-bde0-8a5732d9e3a9', 'b3bf736f-7e11-4e20-9f7e-ead841b8a9e9'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:04 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:05:04 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:05 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.835s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:05 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b Jul 09 03:05:05 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:05 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Deleted volume successfully. Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a7e9a64d-2d9b-46d9-927c-99b239b84272 tempest-CinderUnicodeTest-1707161571 None] Lock "cinder-9007297f-4f76-4313-b81c-caad99c91d44-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:05 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-24d929ba-6aec-490b-9108-dda96268d23b" returned: 0 in 0.736s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "cinder-quobyte-24d929ba-6aec-490b-9108-dda96268d23b" released by "delete_volume" :: held 1.629s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Created reservations ['04591ecb-39bd-43ea-9c55-fad3605dbe4d', '367cf8de-bc67-4fba-b414-1cb7533b3ad5', 'c77d2321-56cc-4cd9-bdf8-d12e5d189e57', '10c6b15a-eb8d-4cb0-98b8-9680f94c63c2'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:06 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:05:06 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:06 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.668s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:06 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Deleted volume successfully. Jul 09 03:05:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9e8187ba-4133-4c88-86af-bf7ef7266653 tempest-TestStampPattern-1785615215 None] Lock "cinder-24d929ba-6aec-490b-9108-dda96268d23b-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:16 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=90,cinder:SELECT=67,cinder:DELETE=8,cinder:INSERT=20 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:16 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=79,cinder:INSERT=26,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Flow 'volume_create_manager' (ee1d404a-25f7-4a54-82bb-c0e1b0ed9aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b33ee-87af-4ddc-a886-174cafa623b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b33ee-87af-4ddc-a886-174cafa623b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9667c93-f220-4821-9c24-6839f94c1d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a59373391440728ffba58548a410f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:20Z,use_quota=True,user_id='ade6a9a79ec74351ab2336a5c43a9192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82abde-7388-4e56-9ded-e778cfc1e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82abde-7388-4e56-9ded-e778cfc1e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112970e0-e6d9-448b-90ad-9843f5114487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:19 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112970e0-e6d9-448b-90ad-9843f5114487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9667c93-f220-4821-9c24-6839f94c1d0e', 'volume_name': 'volume-e9667c93-f220-4821-9c24-6839f94c1d0e', 'volume_size': 1, 'image_id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a953935373de249b76980d85124c426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66a59373391440728ffba58548a410f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03d75785b8a2364b4eece64b039b5df9ecf8682725591445e25c26b08c851bd55af2601cb4d107c2aeb9ab33414789afdce1501e351eafbe205d27763ddb8ad0', 'id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c023fd60-a498-41b7-93a2-a81f5ff6a9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c023fd60-a498-41b7-93a2-a81f5ff6a9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949a17b1-879a-49e7-93c7-097188651b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:20 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Volume e9667c93-f220-4821-9c24-6839f94c1d0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9667c93-f220-4821-9c24-6839f94c1d0e', 'volume_size': 1, 'image_id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a953935373de249b76980d85124c426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66a59373391440728ffba58548a410f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03d75785b8a2364b4eece64b039b5df9ecf8682725591445e25c26b08c851bd55af2601cb4d107c2aeb9ab33414789afdce1501e351eafbe205d27763ddb8ad0', 'id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465/file', 'properties': {}}, 'image_service': } Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Trying to clone e9667c93-f220-4821-9c24-6839f94c1d0e from image c4372073-4ab9-4d6b-9f95-adb8f8b30465 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:05:20 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefaed8-15fa-47f9-b314-946f86b84d91]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:20 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:20 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:20 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:20 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:20 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:21 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 1 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:21 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Temporary image c4372073-4ab9-4d6b-9f95-adb8f8b30465 is fetched for user ade6a9a79ec74351ab2336a5c43a9192. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:05:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b54e0-070a-4dc2-b92f-53e21ea9ec29]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:21 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:21 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:22 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:22 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:22 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:23 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 1 in 0.685s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9667c93-f220-4821-9c24-6839f94c1d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a59373391440728ffba58548a410f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:20Z,use_quota=True,user_id='ade6a9a79ec74351ab2336a5c43a9192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Creating volume e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:23 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:23 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1073741824 Jul 09 03:05:23 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:23 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1073741824" returned: 0 in 0.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:23 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:23 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:24 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 0 in 0.626s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Attempting download of c4372073-4ab9-4d6b-9f95-adb8f8b30465 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}])) to volume e9667c93-f220-4821-9c24-6839f94c1d0e. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd13af3f-dd7f-40ba-b083-c9def9cbda17]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:24 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f Jul 09 03:05:24 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:25 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f" returned: 0 in 0.698s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:25 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f Jul 09 03:05:25 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:25 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f" returned: 1 in 0.688s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4372073-4ab9-4d6b-9f95-adb8f8b30465_0t_7480f' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[36edc493-a390-4a13-af28-e4ea6c2ee509]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:26 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:26 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:26 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:26 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD Jul 09 03:05:26 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:27 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD" returned: 1 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] c4372073-4ab9-4d6b-9f95-adb8f8b30465 was raw, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:27 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:27 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:27 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:05:27 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:28 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4372073-4ab9-4d6b-9f95-adb8f8b30465_jk0i0wuddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:05:28 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:28 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1G Jul 09 03:05:28 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:28 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.641s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:05:28 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e 1G" returned: 0 in 0.666s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ba188-8563-4c0c-855f-59d6c39d3227]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:28 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:28 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:29 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 0 in 0.714s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:29 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:29 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:30 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 1 in 0.717s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Downloaded image c4372073-4ab9-4d6b-9f95-adb8f8b30465 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}])) to volume e9667c93-f220-4821-9c24-6839f94c1d0e successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Temporary image c4372073-4ab9-4d6b-9f95-adb8f8b30465 for user ade6a9a79ec74351ab2336a5c43a9192 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Marking volume e9667c93-f220-4821-9c24-6839f94c1d0e as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Copying metadata from image c4372073-4ab9-4d6b-9f95-adb8f8b30465 to e9667c93-f220-4821-9c24-6839f94c1d0e. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Creating volume glance metadata for volume e9667c93-f220-4821-9c24-6839f94c1d0e backed by image c4372073-4ab9-4d6b-9f95-adb8f8b30465 with: {'image_id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2a953935373de249b76980d85124c426', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949a17b1-879a-49e7-93c7-097188651b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9667c93-f220-4821-9c24-6839f94c1d0e', 'volume_size': 1, 'image_id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a953935373de249b76980d85124c426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66a59373391440728ffba58548a410f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03d75785b8a2364b4eece64b039b5df9ecf8682725591445e25c26b08c851bd55af2601cb4d107c2aeb9ab33414789afdce1501e351eafbe205d27763ddb8ad0', 'id': 'c4372073-4ab9-4d6b-9f95-adb8f8b30465', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4372073-4ab9-4d6b-9f95-adb8f8b30465/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09994fd3-978b-4642-a046-44a03fd5ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Volume volume-e9667c93-f220-4821-9c24-6839f94c1d0e (e9667c93-f220-4821-9c24-6839f94c1d0e): created successfully Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09994fd3-978b-4642-a046-44a03fd5ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Flow 'volume_create_manager' (ee1d404a-25f7-4a54-82bb-c0e1b0ed9aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-28118a7d-263e-4407-9a9d-c15e623ee6e0 tempest-VolumeImageDependencyTests-1836500142 None] Created volume successfully. Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Acquiring lock "cinder-e9667c93-f220-4821-9c24-6839f94c1d0e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "cinder-e9667c93-f220-4821-9c24-6839f94c1d0e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Acquiring lock "cinder-quobyte-e9667c93-f220-4821-9c24-6839f94c1d0e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "cinder-quobyte-e9667c93-f220-4821-9c24-6839f94c1d0e" acquired by "delete_volume" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd37589-495b-42d1-8011-dbd53ff1916e]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:31 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:31 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:32 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 0 in 0.753s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:32 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:32 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:33 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 1 in 0.752s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:33 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e Jul 09 03:05:33 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:33 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e9667c93-f220-4821-9c24-6839f94c1d0e" returned: 0 in 0.633s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "cinder-quobyte-e9667c93-f220-4821-9c24-6839f94c1d0e" released by "delete_volume" :: held 2.191s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Created reservations ['bc2fa4da-921d-4cbd-8a98-954315ee6d4d', '398397d3-310a-4de2-90af-d9144ff5b978', 'a6d14398-f71b-4449-9746-47d313ddeaeb', '66ee09ef-556b-4be3-8940-81a5bef60a1d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:33 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:05:33 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:34 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.672s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:34 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:05:34 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Deleted volume successfully. Jul 09 03:05:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d2d1c80-dcbd-4ebe-b20b-e409c747c35b tempest-VolumeImageDependencyTests-1836500142 None] Lock "cinder-e9667c93-f220-4821-9c24-6839f94c1d0e-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:05:43 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (8280258a-beab-4ade-891c-9def99e8f885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0029f5a2-9032-4a6c-ad31-7efb2a091f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0029f5a2-9032-4a6c-ad31-7efb2a091f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443515085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35162732-ee2c-48bf-89b6-b1d1e0d6f770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095d2549-6fcd-4b4e-ba9c-ce4599d8a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095d2549-6fcd-4b4e-ba9c-ce4599d8a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b591d7d1-1ffc-425f-bf83-3a6b856d5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b591d7d1-1ffc-425f-bf83-3a6b856d5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35162732-ee2c-48bf-89b6-b1d1e0d6f770', 'volume_name': 'volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae83a4-9895-4a69-b50d-00226859a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae83a4-9895-4a69-b50d-00226859a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e03558-455a-4853-9c27-8c9a0b64fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume 35162732-ee2c-48bf-89b6-b1d1e0d6f770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770', 'volume_size': 1} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443515085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35162732-ee2c-48bf-89b6-b1d1e0d6f770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume 35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:50 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 1073741824 Jul 09 03:05:50 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (e90407e7-7a99-4291-8d7a-84a2db6c56c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9534a4cb-d301-429c-b1c5-0a67d1cb5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9534a4cb-d301-429c-b1c5-0a67d1cb5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502442634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae75dae-c333-43b6-9b72-c5a1b0b67661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4186f3-e11b-4ad8-a685-b8d5a98b6f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4186f3-e11b-4ad8-a685-b8d5a98b6f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6c9b14-fb11-4042-8d0c-1f431af93d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6c9b14-fb11-4042-8d0c-1f431af93d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae75dae-c333-43b6-9b72-c5a1b0b67661', 'volume_name': 'volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4250fd19-7d05-4666-82e2-46f1b633d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4250fd19-7d05-4666-82e2-46f1b633d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239c7ec1-1f1d-4679-b0b6-3a83e764beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Volume 7ae75dae-c333-43b6-9b72-c5a1b0b67661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661', 'volume_size': 1} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (8fc44b61-7fb4-49d9-9257-d7894826570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c8892d-2333-489c-8d11-33f02650eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c8892d-2333-489c-8d11-33f02650eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737919802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdffbb5-2a25-4569-a640-830a1cdd7bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6d408b-c25e-4918-b923-ce087f290320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6d408b-c25e-4918-b923-ce087f290320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd756f6a-8aca-4be3-86b4-024613dca745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd756f6a-8aca-4be3-86b4-024613dca745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdffbb5-2a25-4569-a640-830a1cdd7bd7', 'volume_name': 'volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14136ff-2f37-4147-bef1-15992b16a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14136ff-2f37-4147-bef1-15992b16a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b98a19-cea2-44fe-a50f-a50818dd5e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Volume 2bdffbb5-2a25-4569-a640-830a1cdd7bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7', 'volume_size': 1} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (517c879d-db31-486d-bf0d-c9606ef535de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a926d5d3-e5da-4ec8-bc13-04621d6cbaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a926d5d3-e5da-4ec8-bc13-04621d6cbaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290197437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b0fb36-5e07-40d6-97e3-683b6ad3b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c853153-7ed2-48f7-82d2-f801b317c799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c853153-7ed2-48f7-82d2-f801b317c799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcddfd6a-5889-4da2-9db8-1eecfa1c2a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcddfd6a-5889-4da2-9db8-1eecfa1c2a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b0fb36-5e07-40d6-97e3-683b6ad3b7b4', 'volume_name': 'volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba53d01-f33d-4084-a55c-6ee9783f22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba53d01-f33d-4084-a55c-6ee9783f22ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907df584-464c-4a2e-93b4-2826b3f937cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Volume 92b0fb36-5e07-40d6-97e3-683b6ad3b7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4', 'volume_size': 1} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (37a68b16-aa7e-4df8-9df3-7cecfcdf5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c614ac0e-2b75-4b0b-8b33-7611a03c34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c614ac0e-2b75-4b0b-8b33-7611a03c34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811332182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7097ea6-5910-4e71-a5dd-18ef55f4727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:52Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758d457-6d8f-4a68-8fd0-69678af655ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758d457-6d8f-4a68-8fd0-69678af655ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b60fd-2a6d-4b4b-b0f2-55fd8c75c0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b60fd-2a6d-4b4b-b0f2-55fd8c75c0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7097ea6-5910-4e71-a5dd-18ef55f4727a', 'volume_name': 'volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5198a0b-490f-4309-b40a-f4a516abe0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5198a0b-490f-4309-b40a-f4a516abe0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a9bafa-1dd5-40ab-a3e0-858e44de80d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Volume b7097ea6-5910-4e71-a5dd-18ef55f4727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a', 'volume_size': 1} Jul 09 03:05:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:52 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 1073741824" returned: 0 in 1.246s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:52 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 Jul 09 03:05:52 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (1938fccc-ad76-4836-8e88-9b5aa6e8b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89dfa92-b7f6-40db-b470-9dc7f03c54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89dfa92-b7f6-40db-b470-9dc7f03c54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-774552770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4820687-0ae5-45d5-95c1-723d8a63f247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:52Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0819bdf-b638-46a4-8fab-50b62e6f5401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0819bdf-b638-46a4-8fab-50b62e6f5401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de79c6-1048-454c-839c-d0c1fc2e34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de79c6-1048-454c-839c-d0c1fc2e34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4820687-0ae5-45d5-95c1-723d8a63f247', 'volume_name': 'volume-b4820687-0ae5-45d5-95c1-723d8a63f247', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6942638-e977-45f2-ad81-10b4f081b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6942638-e977-45f2-ad81-10b4f081b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf95523-cd76-49b0-bbaa-b74be9d2bdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Volume b4820687-0ae5-45d5-95c1-723d8a63f247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4820687-0ae5-45d5-95c1-723d8a63f247', 'volume_size': 1} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:52 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502442634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae75dae-c333-43b6-9b72-c5a1b0b67661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Creating volume 7ae75dae-c333-43b6-9b72-c5a1b0b67661 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:52 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e03558-455a-4853-9c27-8c9a0b64fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:52 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 1073741824 Jul 09 03:05:52 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d93736-d58b-4201-99fb-932faf4c1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 (35162732-ee2c-48bf-89b6-b1d1e0d6f770): created successfully Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d93736-d58b-4201-99fb-932faf4c1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (8280258a-beab-4ade-891c-9def99e8f885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85a3274d-6e9a-40f7-9a82-455d184439c5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Flow 'volume_create_manager' (6ce46641-fdb4-4f07-918c-c28714aff04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b4344f-f4f2-4a35-8648-f0c52cfec525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b4344f-f4f2-4a35-8648-f0c52cfec525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8854738a-f017-46b0-9f2f-817c02d40925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f7a363563743d8997acd9517af1181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:54Z,use_quota=True,user_id='5d8fffb717114c97a731f03efee16289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b9f75e-40df-40d5-89d7-0cbc12f2a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b9f75e-40df-40d5-89d7-0cbc12f2a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4f0037-055d-400f-b64f-70717f47125a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:05:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:54 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 1073741824" returned: 0 in 1.077s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:54 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 Jul 09 03:05:54 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4f0037-055d-400f-b64f-70717f47125a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8854738a-f017-46b0-9f2f-817c02d40925', 'volume_name': 'volume-8854738a-f017-46b0-9f2f-817c02d40925', 'volume_size': 1, 'image_id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dba400b00da0d22b24c2d1aa2d885582', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81f7a363563743d8997acd9517af1181', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43104931e38afd4bd63f4fc168831249a25a522ebee7972a140adc9222b22b23f7f2b20054d7e232964c9b9e4597ca7cf1111047d7b6cf68cc9b026306edd3f2', 'id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11f748c5-e354-40dc-b4f9-13f9b832362c/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad7ea4d-151b-4396-a03e-9a75a81b30d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad7ea4d-151b-4396-a03e-9a75a81b30d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2e15db-71c5-43db-95fc-b1505a5ef80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Volume 8854738a-f017-46b0-9f2f-817c02d40925: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8854738a-f017-46b0-9f2f-817c02d40925', 'volume_size': 1, 'image_id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dba400b00da0d22b24c2d1aa2d885582', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81f7a363563743d8997acd9517af1181', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43104931e38afd4bd63f4fc168831249a25a522ebee7972a140adc9222b22b23f7f2b20054d7e232964c9b9e4597ca7cf1111047d7b6cf68cc9b026306edd3f2', 'id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11f748c5-e354-40dc-b4f9-13f9b832362c/file', 'properties': {}}, 'image_service': } Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Trying to clone 8854738a-f017-46b0-9f2f-817c02d40925 from image 11f748c5-e354-40dc-b4f9-13f9b832362c at location (None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:05:54 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[296ceddb-5942-4258-a137-8279809f4c39]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:54 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:05:54 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Flow 'volume_create_manager' (29e7a6da-068c-4f1e-92a9-01322b20b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e01026e-3af8-4465-b171-c12cabf0d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e01026e-3af8-4465-b171-c12cabf0d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd6bc6a-8666-4964-8cd9-720f95c8646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fcde5dd11640669810e8f2d127256c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:55Z,use_quota=True,user_id='df7702e2a67b407aa879790c51fe4c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88409a91-cc24-44b2-904c-3d8fcebdac7d),volume_type_id=88409a91-cc24-44b2-904c-3d8fcebdac7d)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377cea36-5cfc-45d6-9102-3e74bd89fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377cea36-5cfc-45d6-9102-3e74bd89fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e83d55f-8c7d-4d82-bcc5-2136e913cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.image.glance [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Creating Keystone auth plugin from conf {{(pid=87156) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 03:05:54 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661" returned: 0 in 0.738s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737919802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bdffbb5-2a25-4569-a640-830a1cdd7bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Creating volume 2bdffbb5-2a25-4569-a640-830a1cdd7bd7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:54 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:54 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 1073741824 Jul 09 03:05:54 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239c7ec1-1f1d-4679-b0b6-3a83e764beab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fda4eb-c027-4801-af2e-166c07ead8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Volume volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 (7ae75dae-c333-43b6-9b72-c5a1b0b67661): created successfully Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fda4eb-c027-4801-af2e-166c07ead8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (e90407e7-7a99-4291-8d7a-84a2db6c56c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-92304846-bc39-4911-a41d-e0615e1c1a7a tempest-CreateVolumesFromImageTest-679878757 None] Created volume successfully. Jul 09 03:05:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e83d55f-8c7d-4d82-bcc5-2136e913cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2bd6bc6a-8666-4964-8cd9-720f95c8646b', 'volume_name': 'volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b', 'volume_size': 1, 'image_id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5dc0f1613f48117ce66d0b54788ad30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71fcde5dd11640669810e8f2d127256c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45a41cba00b9e1e477a02a6c7dd68e7b17b6e8956f9e9855e4467619a7e4a6eed542f725cf2cf68bc5facc23407938a1d6550ed728bfa3b73a12bfc378ddcfbc', 'id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a427fb6-d646-4ba5-a2b8-777696724274/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be348b7-6f3d-4a1f-b7ed-a24e8faa2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be348b7-6f3d-4a1f-b7ed-a24e8faa2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2256299d-29a2-4411-9f5f-5cfb4807708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b', 'volume_size': 1, 'image_id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5dc0f1613f48117ce66d0b54788ad30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71fcde5dd11640669810e8f2d127256c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45a41cba00b9e1e477a02a6c7dd68e7b17b6e8956f9e9855e4467619a7e4a6eed542f725cf2cf68bc5facc23407938a1d6550ed728bfa3b73a12bfc378ddcfbc', 'id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a427fb6-d646-4ba5-a2b8-777696724274/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Trying to clone 2bd6bc6a-8666-4964-8cd9-720f95c8646b from image 9a427fb6-d646-4ba5-a2b8-777696724274 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}]). {{(pid=87156) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 03:05:55 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Image download 0.00 MB at 0.00 MB/s Jul 09 03:05:55 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dceff3a-d700-4ddf-8fcf-40a5c03dfa9f]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:05:55 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:55 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:05:55 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:55 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 1073741824" returned: 0 in 0.893s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 Jul 09 03:05:55 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:55 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 1 in 0.742s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Temporary image 11f748c5-e354-40dc-b4f9-13f9b832362c is fetched for user 5d8fffb717114c97a731f03efee16289. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:05:55 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a3337-ead7-4eda-8a16-2b4e394ec987]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:05:56 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:56 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:05:56 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:56 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.963s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290197437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b0fb36-5e07-40d6-97e3-683b6ad3b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:51Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Creating volume 92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:56 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b98a19-cea2-44fe-a50f-a50818dd5e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:56 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 1073741824 Jul 09 03:05:56 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a258462c-195d-46d6-9b84-9069f5016afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Volume volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 (2bdffbb5-2a25-4569-a640-830a1cdd7bd7): created successfully Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a258462c-195d-46d6-9b84-9069f5016afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (8fc44b61-7fb4-49d9-9257-d7894826570b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e731b2a3-94d4-4ba6-8694-6408ae7630dd tempest-CreateVolumesFromImageTest-679878757 None] Created volume successfully. Jul 09 03:05:56 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 1 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Temporary image 9a427fb6-d646-4ba5-a2b8-777696724274 is fetched for user df7702e2a67b407aa879790c51fe4c6a. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 03:05:56 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfe4ffd-2d6a-4d88-b5f3-8f0f827855bf]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:05:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:56 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:05:56 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:56 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:05:56 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:57 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 1073741824" returned: 0 in 0.860s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:57 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 Jul 09 03:05:57 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:57 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 1 in 0.759s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:57 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:57 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:05:57 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:57 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" returned: 0 in 0.664s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.063s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811332182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7097ea6-5910-4e71-a5dd-18ef55f4727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:52Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Creating volume b7097ea6-5910-4e71-a5dd-18ef55f4727a {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:57 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:58 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a 1073741824 Jul 09 03:05:58 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907df584-464c-4a2e-93b4-2826b3f937cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95415904-18a8-407c-a73b-72e728c91cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:58 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Volume volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 (92b0fb36-5e07-40d6-97e3-683b6ad3b7b4): created successfully Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95415904-18a8-407c-a73b-72e728c91cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (517c879d-db31-486d-bf0d-c9606ef535de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e00f40a6-b56b-4095-b65f-8387fcfcf070 tempest-CreateVolumesFromImageTest-679878757 None] Created volume successfully. Jul 09 03:05:58 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 1 in 0.734s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:58 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a 1073741824" returned: 0 in 0.790s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:58 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a Jul 09 03:05:58 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:59 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a" returned: 0 in 0.626s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.921s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-774552770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4820687-0ae5-45d5-95c1-723d8a63f247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004918475b4f9f8389d42343d33ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:52Z,use_quota=True,user_id='7cc61912f0df4676b296f41d82e2559f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Creating volume b4820687-0ae5-45d5-95c1-723d8a63f247 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:05:59 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a9bafa-1dd5-40ab-a3e0-858e44de80d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:59 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 1073741824 Jul 09 03:05:59 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461df5a6-a1f2-4b36-a191-5f4fe0116153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:05:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Volume volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a (b7097ea6-5910-4e71-a5dd-18ef55f4727a): created successfully Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461df5a6-a1f2-4b36-a191-5f4fe0116153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:05:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (37a68b16-aa7e-4df8-9df3-7cecfcdf5adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:05:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-83cd772f-1fdd-4c4d-aca6-c16c99467a16 tempest-CreateVolumesFromImageTest-679878757 None] Created volume successfully. Jul 09 03:06:00 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 1073741824" returned: 0 in 0.861s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:00 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 Jul 09 03:06:00 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:01 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247" returned: 0 in 0.661s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.101s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf95523-cd76-49b0-bbaa-b74be9d2bdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4820687-0ae5-45d5-95c1-723d8a63f247', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740a8ce-4dde-4785-a107-c97433cdd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating offline snapshot cfae228f-76c9-4a17-b991-39458ab119c2 of volume 35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:06:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Volume volume-b4820687-0ae5-45d5-95c1-723d8a63f247 (b4820687-0ae5-45d5-95c1-723d8a63f247): created successfully Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740a8ce-4dde-4785-a107-c97433cdd129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Flow 'volume_create_manager' (1938fccc-ad76-4836-8e88-9b5aa6e8b9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5372f010-6f60-4016-b3ec-470381cb9225]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8626c0a4-bc88-4c08-9c14-6ca836a8c876 tempest-CreateVolumesFromImageTest-679878757 None] Created volume successfully. Jul 09 03:06:01 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 Jul 09 03:06:01 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-b4820687-0ae5-45d5-95c1-723d8a63f247-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-b4820687-0ae5-45d5-95c1-723d8a63f247-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-quobyte-b4820687-0ae5-45d5-95c1-723d8a63f247" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-b4820687-0ae5-45d5-95c1-723d8a63f247" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1171af4-d093-44f4-a203-20ba3509c05d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:01 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 Jul 09 03:06:01 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:01 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:01 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 1G Jul 09 03:06:01 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:02 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:02 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247 Jul 09 03:06:02 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:02 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 1G" returned: 0 in 0.877s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:02 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 Jul 09 03:06:02 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:02 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b4820687-0ae5-45d5-95c1-723d8a63f247" returned: 0 in 0.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-b4820687-0ae5-45d5-95c1-723d8a63f247" released by "delete_volume" :: held 1.513s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Created reservations ['106f7922-c163-4675-9046-8e0c092c2244', 'c437c79d-832a-412e-9fe5-93514add4ac2', '7862007e-9827-464f-9887-19d65a4f3198', 'cb8c69d2-a8df-40d8-8ca8-22fdf7570d1f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:03 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:03 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-b7097ea6-5910-4e71-a5dd-18ef55f4727a-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:03 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2" returned: 0 in 0.759s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:03 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 is being set with open permissions: ugo+rw Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-b7097ea6-5910-4e71-a5dd-18ef55f4727a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:03 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 Jul 09 03:06:03 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-quobyte-b7097ea6-5910-4e71-a5dd-18ef55f4727a" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-b7097ea6-5910-4e71-a5dd-18ef55f4727a" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9ba51-a1e7-464d-a0ba-d27b48ad49b0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:03 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Deleted volume successfully. Jul 09 03:06:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-4bd1d2e6-7291-409d-827a-5739ae8c7bf2 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-b4820687-0ae5-45d5-95c1-723d8a63f247-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:03 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a Jul 09 03:06:03 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:04 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2" returned: 0 in 0.699s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:04 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info Jul 09 03:06:04 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:04 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:04 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a Jul 09 03:06:04 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:04 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:04 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info is being set with open permissions: ugo+rw Jul 09 03:06:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:04 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info Jul 09 03:06:04 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:05 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b7097ea6-5910-4e71-a5dd-18ef55f4727a" returned: 0 in 0.671s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-b7097ea6-5910-4e71-a5dd-18ef55f4727a" released by "delete_volume" :: held 1.526s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Created reservations ['a5f57396-2e60-4389-9e78-34f9442d8997', 'c4f01e04-9df6-4b32-afce-8a7bde15c7f9', '6a1d52d3-a865-4919-971d-4af1355eee97', '779654af-5c6c-4deb-af6c-70a9757da20b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:05 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:05 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:05 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.info" returned: 0 in 0.622s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.058s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8854738a-f017-46b0-9f2f-817c02d40925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f7a363563743d8997acd9517af1181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:54Z,use_quota=True,user_id='5d8fffb717114c97a731f03efee16289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Creating volume 8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:05 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:05 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1073741824 Jul 09 03:06:05 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7be46c15-0d2f-4019-b3df-79d504f8abbf tempest-CreateVolumesFromSnapshotTest-1007405023 None] Create snapshot completed successfully Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-quobyte-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62857e0-867e-47e2-ba06-2d0b0b376c05]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:05 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.684s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Deleted volume successfully. Jul 09 03:06:05 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 Jul 09 03:06:05 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-85f9e04e-7414-443c-9685-16c969c8da95 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-b7097ea6-5910-4e71-a5dd-18ef55f4727a-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:06 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1073741824" returned: 0 in 0.856s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:06 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:06 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:06 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:06 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4 Jul 09 03:06:06 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (958648a7-7a26-4b47-99ed-33722170070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e74571-792e-4651-8734-906346c49242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e74571-792e-4651-8734-906346c49242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183662637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9964314d-b8c4-4cdc-8800-a03cb06da063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:07Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b567e7-2c4b-40d8-aed1-cb430499b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b567e7-2c4b-40d8-aed1-cb430499b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85860d8-99be-4b88-ad08-7703e7fc97b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85860d8-99be-4b88-ad08-7703e7fc97b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9964314d-b8c4-4cdc-8800-a03cb06da063', 'volume_name': 'volume-9964314d-b8c4-4cdc-8800-a03cb06da063', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a99369-4633-4e47-8860-73836d3801da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a99369-4633-4e47-8860-73836d3801da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88794fa2-a981-4d93-a305-3fb1f4952df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:06 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume 9964314d-b8c4-4cdc-8800-a03cb06da063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9964314d-b8c4-4cdc-8800-a03cb06da063', 'volume_size': 1} Jul 09 03:06:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (f3408f2d-df7b-4357-b1a6-b5547b8c4ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de118362-bb17-4a1f-b273-abdfbcc52945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de118362-bb17-4a1f-b273-abdfbcc52945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451676345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c513ed-9c44-4e71-9d6d-60510c077065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:07Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c749e-3ab5-4d41-9fef-0cc0124275a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c749e-3ab5-4d41-9fef-0cc0124275a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4416173f-b3e2-447c-be3f-e5d59d9f0af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4416173f-b3e2-447c-be3f-e5d59d9f0af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c513ed-9c44-4e71-9d6d-60510c077065', 'volume_name': 'volume-08c513ed-9c44-4e71-9d6d-60510c077065', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15602ee9-9c30-4346-833e-90c055115d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15602ee9-9c30-4346-833e-90c055115d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d338cc-1712-4714-8241-8a5bfbf3ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume 08c513ed-9c44-4e71-9d6d-60510c077065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c513ed-9c44-4e71-9d6d-60510c077065', 'volume_size': 1} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:07 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 0 in 0.866s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.040s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd6bc6a-8666-4964-8cd9-720f95c8646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fcde5dd11640669810e8f2d127256c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:05:55Z,use_quota=True,user_id='df7702e2a67b407aa879790c51fe4c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88409a91-cc24-44b2-904c-3d8fcebdac7d),volume_type_id=88409a91-cc24-44b2-904c-3d8fcebdac7d)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Creating volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:07 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:07 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1073741824 Jul 09 03:06:07 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Attempting download of 11f748c5-e354-40dc-b4f9-13f9b832362c ((None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}])) to volume 8854738a-f017-46b0-9f2f-817c02d40925. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2dbadd-501b-49bd-87db-2d0637c7efbb]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:07 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" returned: 0 in 0.900s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4" released by "delete_volume" :: held 1.752s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:07 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b Jul 09 03:06:07 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (d1d8ad14-a3e5-445f-93a6-4600947d70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9ad4f3-afc0-4f8b-a5e4-e39402bc5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9ad4f3-afc0-4f8b-a5e4-e39402bc5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663599167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfba574-262c-4e81-8657-ed0b0f394ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:08Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd659c9-433c-4ff2-8ecb-934e977ad426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd659c9-433c-4ff2-8ecb-934e977ad426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ab38c-2de8-4059-9412-d10b4d2bf07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ab38c-2de8-4059-9412-d10b4d2bf07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfba574-262c-4e81-8657-ed0b0f394ff5', 'volume_name': 'volume-cdfba574-262c-4e81-8657-ed0b0f394ff5', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9ee3aa-79a9-4c84-83c8-f0b0ce47a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9ee3aa-79a9-4c84-83c8-f0b0ce47a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176fddbf-f6b5-4736-92b6-cdaca9b545fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:07 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume cdfba574-262c-4e81-8657-ed0b0f394ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfba574-262c-4e81-8657-ed0b0f394ff5', 'volume_size': 1} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Created reservations ['6edff12c-5fb0-4005-bd64-d3449e7f80b2', 'c50b0023-1c78-48fe-9f93-2e96450f4fc0', '334eefb2-ab50-45d6-8046-3fc1fa83e7bb', '8aed5b2f-a3ae-4271-87b1-356904e29361'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:07 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:07 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-2bdffbb5-2a25-4569-a640-830a1cdd7bd7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-2bdffbb5-2a25-4569-a640-830a1cdd7bd7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (c4af22e3-e9a2-4641-92b0-b24ead0722b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2380c7f-df97-47e2-b903-d8b8e4fb0fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2380c7f-df97-47e2-b903-d8b8e4fb0fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362436570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c520a19a-6d4c-4b26-9b70-4f0d914079a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:08Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4050db62-8a10-46d2-b66b-d19d284ae845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4050db62-8a10-46d2-b66b-d19d284ae845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd578782-31cb-4eb2-ac6b-ba9cfb274bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd578782-31cb-4eb2-ac6b-ba9cfb274bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c520a19a-6d4c-4b26-9b70-4f0d914079a3', 'volume_name': 'volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62531701-f828-49b5-bf1a-046a8f8f1b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62531701-f828-49b5-bf1a-046a8f8f1b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162d0a0-8cf8-4796-a10e-194d816fe405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume c520a19a-6d4c-4b26-9b70-4f0d914079a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3', 'volume_size': 1} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-quobyte-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[683eb533-8650-4377-be01-b8d4e2aee83e]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:08 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1073741824" returned: 0 in 1.196s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:08 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b" returned: 0 in 1.096s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:08 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 Jul 09 03:06:08 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:08 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:08 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:08 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b Jul 09 03:06:08 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:08 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.982s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Deleted volume successfully. Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (97c3de3c-3956-43c8-9dd3-8f608f7ad6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53465028-af0e-41ce-be25-d3a1bd524d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53465028-af0e-41ce-be25-d3a1bd524d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761420268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7785a3f-2bce-4413-9fd2-7678c374fd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:09Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d785ab0e-b361-4309-8b4d-bba2c291abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d785ab0e-b361-4309-8b4d-bba2c291abb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0ec490-0e8b-4ed7-b091-550426612f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0ec490-0e8b-4ed7-b091-550426612f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7785a3f-2bce-4413-9fd2-7678c374fd06', 'volume_name': 'volume-e7785a3f-2bce-4413-9fd2-7678c374fd06', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f618e1c-a5de-4c5a-9a0b-7b33fba969cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f618e1c-a5de-4c5a-9a0b-7b33fba969cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9345f7dd-1348-49d9-a32c-03bef065b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:08 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume e7785a3f-2bce-4413-9fd2-7678c374fd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7785a3f-2bce-4413-9fd2-7678c374fd06', 'volume_size': 1} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f0f655f2-f1af-4e5d-b370-240573aceeb8 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-92b0fb36-5e07-40d6-97e3-683b6ad3b7b4-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:09 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" returned: 0 in 0.989s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:09 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7 Jul 09 03:06:09 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:09 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b" returned: 1 in 0.917s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11f748c5-e354-40dc-b4f9-13f9b832362c_gob4aa0b' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbad467-77fb-4025-8f1e-b87df0684334]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:09 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:06:09 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:09 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 0 in 0.983s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183662637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9964314d-b8c4-4cdc-8800-a03cb06da063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:07Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume 9964314d-b8c4-4cdc-8800-a03cb06da063 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:09 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:09 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 1073741824 Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Attempting download of 9a427fb6-d646-4ba5-a2b8-777696724274 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}])) to volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 03:06:09 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f25475-8307-4388-bfed-88201ece2001]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:09 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf Jul 09 03:06:09 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" returned: 0 in 0.722s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-2bdffbb5-2a25-4569-a640-830a1cdd7bd7" released by "delete_volume" :: held 1.774s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Created reservations ['5629dcc3-5c8d-4e03-a646-bd720e9aea51', '6e5709e8-1cb0-4825-8f34-c55d3ec7b78b', 'fd690d6c-3a0d-470b-864d-0b638a9861e2', 'bae43a3c-62f8-45e1-9d6f-286c0c57e216'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:10 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-7ae75dae-c333-43b6-9b72-c5a1b0b67661-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-7ae75dae-c333-43b6-9b72-c5a1b0b67661-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:10 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD Jul 09 03:06:10 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "cinder-quobyte-7ae75dae-c333-43b6-9b72-c5a1b0b67661" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-7ae75dae-c333-43b6-9b72-c5a1b0b67661" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[079fdd32-15e0-435b-af17-f0ef2cf0fc44]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf" returned: 0 in 0.842s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 Jul 09 03:06:10 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf Jul 09 03:06:10 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:10 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 1073741824" returned: 0 in 1.170s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:10 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 Jul 09 03:06:10 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD" returned: 1 in 1.010s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:11 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] 11f748c5-e354-40dc-b4f9-13f9b832362c was raw, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.104s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Deleted volume successfully. Jul 09 03:06:11 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:11 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e82d7964-a2fc-4b88-8770-614386a210d6 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-2bdffbb5-2a25-4569-a640-830a1cdd7bd7-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:11 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf" returned: 1 in 0.982s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a427fb6-d646-4ba5-a2b8-777696724274_60xk1ywf' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668f304-6ae6-4228-85ed-e05293f2b484]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:11 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661" returned: 0 in 1.061s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:11 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661 Jul 09 03:06:11 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063" returned: 0 in 0.855s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.499s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451676345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c513ed-9c44-4e71-9d6d-60510c077065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:07Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume 08c513ed-9c44-4e71-9d6d-60510c077065 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:11 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:11 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:06:11 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88794fa2-a981-4d93-a305-3fb1f4952df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9964314d-b8c4-4cdc-8800-a03cb06da063', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:11 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 1073741824 Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c85365-50b7-40da-ad17-f1a9d125c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:11 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-9964314d-b8c4-4cdc-8800-a03cb06da063 (9964314d-b8c4-4cdc-8800-a03cb06da063): created successfully Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c85365-50b7-40da-ad17-f1a9d125c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (958648a7-7a26-4b47-99ed-33722170070e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-081fa880-1222-4bc9-9225-ee9ff15ab692 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:06:12 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 0 in 0.970s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11f748c5-e354-40dc-b4f9-13f9b832362c_t2nebin3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:06:12 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:12 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1G Jul 09 03:06:12 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:12 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-7ae75dae-c333-43b6-9b72-c5a1b0b67661" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-quobyte-7ae75dae-c333-43b6-9b72-c5a1b0b67661" released by "delete_volume" :: held 1.891s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Created reservations ['369de4e9-c671-4c5e-8f16-708f6efdac67', 'e6c306f2-704a-4616-9d30-7c990d9ce15f', 'dd7fbc68-23c0-4ea5-8308-b81b206faf57', '7e7b3871-17dc-4b08-a498-af5c486e5f52'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:12 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:12 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:12 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 0 in 1.099s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:12 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 1073741824" returned: 0 in 1.045s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:12 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 Jul 09 03:06:12 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:12 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD Jul 09 03:06:12 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 1G" returned: 0 in 0.978s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef004cc-0c2c-4227-9c90-211d8e1d265a]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.897s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Deleted volume successfully. Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d13aaa01-8403-4f77-a45c-0d9f86984468 tempest-CreateVolumesFromImageTest-679878757 None] Lock "cinder-7ae75dae-c333-43b6-9b72-c5a1b0b67661-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:13 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:13 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD" returned: 1 in 1.081s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] 9a427fb6-d646-4ba5-a2b8-777696724274 was raw, converting to raw {{(pid=87156) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065" returned: 0 in 0.948s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:13 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:13 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.092s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663599167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfba574-262c-4e81-8657-ed0b0f394ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:08Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume cdfba574-262c-4e81-8657-ed0b0f394ff5 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:13 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d338cc-1712-4714-8241-8a5bfbf3ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c513ed-9c44-4e71-9d6d-60510c077065', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:13 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 1073741824 Jul 09 03:06:13 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31332943-abc3-44b0-b823-9a4ebd2ff5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:13 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-08c513ed-9c44-4e71-9d6d-60510c077065 (08c513ed-9c44-4e71-9d6d-60510c077065): created successfully Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31332943-abc3-44b0-b823-9a4ebd2ff5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:13 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (f3408f2d-df7b-4357-b1a6-b5547b8c4ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d0132aa6-f5c9-4128-918f-893c90d9fa58 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:06:14 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 0 in 1.074s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:14 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:14 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:14 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 0 in 0.986s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a427fb6-d646-4ba5-a2b8-777696724274_dcqbbqxtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:06:14 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:14 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1G Jul 09 03:06:14 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:14 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 1073741824" returned: 0 in 1.035s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:14 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 Jul 09 03:06:14 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:15 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 1 in 0.971s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Downloaded image 11f748c5-e354-40dc-b4f9-13f9b832362c ((None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}])) to volume 8854738a-f017-46b0-9f2f-817c02d40925 successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Temporary image 11f748c5-e354-40dc-b4f9-13f9b832362c for user 5d8fffb717114c97a731f03efee16289 is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Marking volume 8854738a-f017-46b0-9f2f-817c02d40925 as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Copying metadata from image 11f748c5-e354-40dc-b4f9-13f9b832362c to 8854738a-f017-46b0-9f2f-817c02d40925. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Creating volume glance metadata for volume 8854738a-f017-46b0-9f2f-817c02d40925 backed by image 11f748c5-e354-40dc-b4f9-13f9b832362c with: {'image_id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dba400b00da0d22b24c2d1aa2d885582', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2e15db-71c5-43db-95fc-b1505a5ef80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8854738a-f017-46b0-9f2f-817c02d40925', 'volume_size': 1, 'image_id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11f748c5-e354-40dc-b4f9-13f9b832362c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dba400b00da0d22b24c2d1aa2d885582', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81f7a363563743d8997acd9517af1181', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43104931e38afd4bd63f4fc168831249a25a522ebee7972a140adc9222b22b23f7f2b20054d7e232964c9b9e4597ca7cf1111047d7b6cf68cc9b026306edd3f2', 'id': '11f748c5-e354-40dc-b4f9-13f9b832362c', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11f748c5-e354-40dc-b4f9-13f9b832362c/file', 'properties': {}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8139053e-6e4a-4d3a-a310-e6297552819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:15 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Volume volume-8854738a-f017-46b0-9f2f-817c02d40925 (8854738a-f017-46b0-9f2f-817c02d40925): created successfully Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8139053e-6e4a-4d3a-a310-e6297552819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Flow 'volume_create_manager' (6ce46641-fdb4-4f07-918c-c28714aff04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-72a574d6-f070-47eb-822c-07c105df51c7 tempest-VolumeImageDependencyTests-1787361951 None] Created volume successfully. Jul 09 03:06:15 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b 1G" returned: 0 in 0.859s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721ff5a-9ac8-4e1f-9ed4-f1de99a3b68d]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:15 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5" returned: 0 in 0.792s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.408s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362436570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c520a19a-6d4c-4b26-9b70-4f0d914079a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:08Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume c520a19a-6d4c-4b26-9b70-4f0d914079a3 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:15 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176fddbf-f6b5-4736-92b6-cdaca9b545fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfba574-262c-4e81-8657-ed0b0f394ff5', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a876d0-504d-4a43-b70a-ac3baef8dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:15 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 1073741824 Jul 09 03:06:15 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:15 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 (cdfba574-262c-4e81-8657-ed0b0f394ff5): created successfully Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a876d0-504d-4a43-b70a-ac3baef8dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:15 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:15 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (d1d8ad14-a3e5-445f-93a6-4600947d70aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:15 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9b9e8701-80d9-4af4-af11-4e24ea3083f2 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Acquiring lock "cinder-8854738a-f017-46b0-9f2f-817c02d40925-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "cinder-8854738a-f017-46b0-9f2f-817c02d40925-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Acquiring lock "cinder-quobyte-8854738a-f017-46b0-9f2f-817c02d40925" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "cinder-quobyte-8854738a-f017-46b0-9f2f-817c02d40925" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:16 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Flow 'volume_create_manager' (07c3f4f9-83ea-420a-bc65-e0a3331e7a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbded312-5ebc-48c7-8e11-15a680e91c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870ff4d-3ad4-44cc-9335-6e689a011e56]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 0 in 1.012s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbded312-5ebc-48c7-8e11-15a680e91c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1127405545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd119f66-d69c-47c8-aece-6887d65ef5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391dba7a97ab4d50b372edef9b0983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:17Z,use_quota=True,user_id='2a44afcd58374ee78de7510d9ca85cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9da1a3-5683-49ed-a60e-aa55628484c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9da1a3-5683-49ed-a60e-aa55628484c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:16 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77d4a36-fbb1-4b9e-a1c3-af06a3d814e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77d4a36-fbb1-4b9e-a1c3-af06a3d814e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd119f66-d69c-47c8-aece-6887d65ef5f6', 'volume_name': 'volume-bd119f66-d69c-47c8-aece-6887d65ef5f6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5648fd51-71dd-4c7f-ade8-908482fa2497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5648fd51-71dd-4c7f-ade8-908482fa2497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c8d60e-97c5-423a-a38e-7a3f33f4752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Volume bd119f66-d69c-47c8-aece-6887d65ef5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd119f66-d69c-47c8-aece-6887d65ef5f6', 'volume_size': 1} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 1073741824" returned: 0 in 1.020s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:16 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:16 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:16 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:16 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:16 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 Jul 09 03:06:16 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:17 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 1 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Downloaded image 9a427fb6-d646-4ba5-a2b8-777696724274 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}])) to volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b successfully. {{(pid=87156) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Temporary image 9a427fb6-d646-4ba5-a2b8-777696724274 for user df7702e2a67b407aa879790c51fe4c6a is deleted. {{(pid=87156) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.volume_utils [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Marking volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b as bootable. {{(pid=87156) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Copying metadata from image 9a427fb6-d646-4ba5-a2b8-777696724274 to 2bd6bc6a-8666-4964-8cd9-720f95c8646b. {{(pid=87156) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Creating volume glance metadata for volume 2bd6bc6a-8666-4964-8cd9-720f95c8646b backed by image 9a427fb6-d646-4ba5-a2b8-777696724274 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f5dc0f1613f48117ce66d0b54788ad30', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87156) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 03:06:17 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:17 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 0 in 0.803s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.550s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761420268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7785a3f-2bce-4413-9fd2-7678c374fd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215239ec3cdb47e6b7ef156b882c8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:09Z,use_quota=True,user_id='218bdc13f58a4b1794d8f5adc2c1bbe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Creating volume e7785a3f-2bce-4413-9fd2-7678c374fd06 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:17 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:17 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 1073741824 Jul 09 03:06:17 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162d0a0-8cf8-4796-a10e-194d816fe405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a427dd4-e8ee-4331-b877-111e943e5794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 (c520a19a-6d4c-4b26-9b70-4f0d914079a3): created successfully Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a427dd4-e8ee-4331-b877-111e943e5794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (c4af22e3-e9a2-4641-92b0-b24ead0722b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:17 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:17 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-27027748-d04e-4a3d-998b-9fb8977d6de5 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2256299d-29a2-4411-9f5f-5cfb4807708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b', 'volume_size': 1, 'image_id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a427fb6-d646-4ba5-a2b8-777696724274', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5dc0f1613f48117ce66d0b54788ad30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71fcde5dd11640669810e8f2d127256c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45a41cba00b9e1e477a02a6c7dd68e7b17b6e8956f9e9855e4467619a7e4a6eed542f725cf2cf68bc5facc23407938a1d6550ed728bfa3b73a12bfc378ddcfbc', 'id': '9a427fb6-d646-4ba5-a2b8-777696724274', 'created_at': datetime.datetime(2026, 7, 9, 1, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 1, 5, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a427fb6-d646-4ba5-a2b8-777696724274/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdab016a-69c8-4007-891f-785c740d09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:17 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Volume volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b (2bd6bc6a-8666-4964-8cd9-720f95c8646b): created successfully Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdab016a-69c8-4007-891f-785c740d09bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:17 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Flow 'volume_create_manager' (29e7a6da-068c-4f1e-92a9-01322b20b52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-0266a852-68de-4263-96b9-57a956d26d81 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Created volume successfully. Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Acquiring lock "cinder-2bd6bc6a-8666-4964-8cd9-720f95c8646b-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:18 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 1 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "cinder-2bd6bc6a-8666-4964-8cd9-720f95c8646b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:18 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925 Jul 09 03:06:18 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Acquiring lock "cinder-quobyte-2bd6bc6a-8666-4964-8cd9-720f95c8646b" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "cinder-quobyte-2bd6bc6a-8666-4964-8cd9-720f95c8646b" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dadf42f-d689-40b3-bc5e-c10b41681ce4]: (4, 'raw') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:18 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 1073741824" returned: 0 in 0.960s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:18 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:18 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:18 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 Jul 09 03:06:18 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:18 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-8854738a-f017-46b0-9f2f-817c02d40925" returned: 0 in 0.698s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "cinder-quobyte-8854738a-f017-46b0-9f2f-817c02d40925" released by "delete_volume" :: held 2.418s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Created reservations ['b163011c-32fe-4b0f-b85e-5c52079fdcad', '9caaf73f-927b-4109-9bf7-ce947ba88a48', 'c301f2b2-cf85-4a79-8b90-05d2caabe467', 'a3f78b56-26a7-44a5-9a0a-626658e50d60'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:19 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:19 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:19 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06" returned: 0 in 0.698s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.462s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1127405545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd119f66-d69c-47c8-aece-6887d65ef5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391dba7a97ab4d50b372edef9b0983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:17Z,use_quota=True,user_id='2a44afcd58374ee78de7510d9ca85cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Creating volume bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:19 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:19 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9345f7dd-1348-49d9-a32c-03bef065b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7785a3f-2bce-4413-9fd2-7678c374fd06', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:19 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 1073741824 Jul 09 03:06:19 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c45f82-4d18-4074-9b24-403aa999c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 0 in 0.853s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:19 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Volume volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 (e7785a3f-2bce-4413-9fd2-7678c374fd06): created successfully Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c45f82-4d18-4074-9b24-403aa999c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Flow 'volume_create_manager' (97c3de3c-3956-43c8-9dd3-8f608f7ad6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-61bcfe7a-53d7-4062-803d-a576e6c147ab tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created volume successfully. Jul 09 03:06:19 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:19 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:19 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Deleted volume successfully. Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-51b33ed2-d21a-47f0-ac23-1fe34860cc75 tempest-VolumeImageDependencyTests-1787361951 None] Lock "cinder-8854738a-f017-46b0-9f2f-817c02d40925-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-e7785a3f-2bce-4413-9fd2-7678c374fd06-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-e7785a3f-2bce-4413-9fd2-7678c374fd06-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-e7785a3f-2bce-4413-9fd2-7678c374fd06" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-e7785a3f-2bce-4413-9fd2-7678c374fd06" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e9c9c-670e-46f9-b7b5-169e0470c69b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:20 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 Jul 09 03:06:20 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:20 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 1 in 0.926s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b' failed. Not Retrying. {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:20 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b Jul 09 03:06:20 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:20 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 1073741824" returned: 0 in 1.025s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:20 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:20 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:20 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06" returned: 0 in 0.881s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:20 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06 Jul 09 03:06:20 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:21 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-2bd6bc6a-8666-4964-8cd9-720f95c8646b" returned: 0 in 0.842s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:21 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.768s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "cinder-quobyte-2bd6bc6a-8666-4964-8cd9-720f95c8646b" released by "delete_volume" :: held 2.714s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c8d60e-97c5-423a-a38e-7a3f33f4752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd119f66-d69c-47c8-aece-6887d65ef5f6', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec57205a-b461-4d7d-86f7-5b27aa55d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:21 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Volume volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 (bd119f66-d69c-47c8-aece-6887d65ef5f6): created successfully Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec57205a-b461-4d7d-86f7-5b27aa55d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Flow 'volume_create_manager' (07c3f4f9-83ea-420a-bc65-e0a3331e7a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-03688e49-56b6-4db8-a85f-cc4865a1bd7f tempest-VolumeDependencyTests-571368471 None] Created volume successfully. Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Created reservations ['b68725db-13fc-4349-bdc5-2d58617bc26e', 'a2ee3aea-d549-4f3d-a89f-e35cde91f25c', 'a201c45f-9f12-433a-a1f4-8389f14048ad', '4dec1190-9170-4285-ba87-571511f0ff5b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:21 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:21 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:21 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e7785a3f-2bce-4413-9fd2-7678c374fd06" returned: 0 in 0.812s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-e7785a3f-2bce-4413-9fd2-7678c374fd06" released by "delete_volume" :: held 1.763s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['9f0c8e21-5980-45d8-837c-c5502b1570dd', '7c1dcc35-6ef9-4a55-930d-07a614bdd7e1', '5ca88d17-74df-4018-ae62-6c9fa673d4a0', 'f6ea1e84-ebc1-45a4-b9f2-4c9a80c2f6b0'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:22 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:22 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:22 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.896s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Deleted volume successfully. Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-29d23f4b-cdb8-4f74-bc37-e89c38cbca40 tempest-VolumeAndVolumeTypeFromImageTest-1076554256 None] Lock "cinder-2bd6bc6a-8666-4964-8cd9-720f95c8646b-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-c520a19a-6d4c-4b26-9b70-4f0d914079a3-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Creating offline snapshot 8df5da8d-546a-46ce-b186-c223d3a33f29 of volume bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-c520a19a-6d4c-4b26-9b70-4f0d914079a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa025b78-e470-4ffe-bbe2-b6c10acf81df]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-c520a19a-6d4c-4b26-9b70-4f0d914079a3" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-c520a19a-6d4c-4b26-9b70-4f0d914079a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c25d1-f366-4556-8bc5-88d19ca49a7f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:22 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:22 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:22 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 Jul 09 03:06:22 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:23 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.035s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3db59680-cf29-47ca-8307-74786f09d2c4 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-e7785a3f-2bce-4413-9fd2-7678c374fd06-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:23 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.964s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:23 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 1G Jul 09 03:06:23 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:23 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3" returned: 0 in 0.992s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:23 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3 Jul 09 03:06:23 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:24 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Flow 'volume_create_manager' (c296a873-872b-4471-af5a-4357a6d16f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa593c11-aea3-4054-8d80-9ef1d8c4f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 1G" returned: 0 in 1.038s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa593c11-aea3-4054-8d80-9ef1d8c4f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666f650b-08d3-4e38-be42-e9b09643f89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a31e83ed7b4b519f3d5f880ad877f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:24Z,use_quota=True,user_id='ce9ceb5d8c33487dbf7e2093a9228104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:24 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:24 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:24 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88619d51-0ddf-4bdc-953f-80723131591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88619d51-0ddf-4bdc-953f-80723131591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddb61e-161a-4b45-b6e6-d01c6d32fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddb61e-161a-4b45-b6e6-d01c6d32fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666f650b-08d3-4e38-be42-e9b09643f89a', 'volume_name': 'volume-666f650b-08d3-4e38-be42-e9b09643f89a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b760f433-6e8e-45c2-bff8-5dddc90dc76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b760f433-6e8e-45c2-bff8-5dddc90dc76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfe45d-749e-41a5-89d4-69f5e4e8ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Volume 666f650b-08d3-4e38-be42-e9b09643f89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666f650b-08d3-4e38-be42-e9b09643f89a', 'volume_size': 1} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-c520a19a-6d4c-4b26-9b70-4f0d914079a3" returned: 0 in 0.966s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-c520a19a-6d4c-4b26-9b70-4f0d914079a3" released by "delete_volume" :: held 2.013s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['51c1cffb-5119-4b3c-8664-06c42f17bf30', '8c923c3d-3d1d-4b5e-9f15-965d3f3ae78d', '4f76be95-6555-447d-a448-9e379299649a', '3e138c04-baef-4d82-b20b-5b9f7123310f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:24 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:24 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-cdfba574-262c-4e81-8657-ed0b0f394ff5-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-cdfba574-262c-4e81-8657-ed0b0f394ff5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-cdfba574-262c-4e81-8657-ed0b0f394ff5" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-cdfba574-262c-4e81-8657-ed0b0f394ff5" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1b3f1-605b-45f5-bebc-52979adb449b]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:24 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 Jul 09 03:06:24 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:25 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 0.975s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:25 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 is being set with open permissions: ugo+rw Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:25 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:25 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:25 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8df97b57-f291-4aa9-915f-d9f48bd433df tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-c520a19a-6d4c-4b26-9b70-4f0d914079a3-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:25 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5" returned: 0 in 0.984s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:25 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5 Jul 09 03:06:25 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:26 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 0.734s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:26 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info Jul 09 03:06:26 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:26 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-cdfba574-262c-4e81-8657-ed0b0f394ff5" returned: 0 in 0.713s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-cdfba574-262c-4e81-8657-ed0b0f394ff5" released by "delete_volume" :: held 1.737s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['c7884054-f619-4841-abe4-dba97e7ae7a4', '7aacfda8-38df-4cae-9242-11801c0ce79d', 'a798da21-52ae-4245-a983-ed6b8da4359b', '673c3bce-0162-47f3-9cf6-e9e6106c1ef5'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:26 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:26 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:26 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:26 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info is being set with open permissions: ugo+rw Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:26 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info Jul 09 03:06:26 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-08c513ed-9c44-4e71-9d6d-60510c077065-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-08c513ed-9c44-4e71-9d6d-60510c077065-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-08c513ed-9c44-4e71-9d6d-60510c077065" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-08c513ed-9c44-4e71-9d6d-60510c077065" acquired by "delete_volume" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8291640-7c89-4d94-ac64-10ba7166eff2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:27 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 Jul 09 03:06:27 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:27 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.757s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-83cf6ea2-b93f-4bb5-ba0c-8a12b398eeb1 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-cdfba574-262c-4e81-8657-ed0b0f394ff5-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:27 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.info" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.369s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.220s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666f650b-08d3-4e38-be42-e9b09643f89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a31e83ed7b4b519f3d5f880ad877f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:24Z,use_quota=True,user_id='ce9ceb5d8c33487dbf7e2093a9228104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Creating volume 666f650b-08d3-4e38-be42-e9b09643f89a {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:27 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:27 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a 1073741824 Jul 09 03:06:27 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1eefba2d-6492-4502-bbbf-622514f68bf0 tempest-VolumeDependencyTests-571368471 None] Create snapshot completed successfully Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:27 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065" returned: 0 in 0.862s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:28 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:28 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:28 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065 Jul 09 03:06:28 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-0f2a30a2-6f94-48a4-ab3a-4404b045d192 tempest-ProjectAdminTests-959741303 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87156) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 03:06:28 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a 1073741824" returned: 0 in 0.857s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:28 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a Jul 09 03:06:28 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:28 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.684s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:06:28 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-08c513ed-9c44-4e71-9d6d-60510c077065" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-08c513ed-9c44-4e71-9d6d-60510c077065" released by "delete_volume" :: held 1.642s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['9d6cf89f-7b58-47ed-a5f5-18a2329cc7d5', '75b4886a-0cc0-49a2-a025-56b330ac5529', '87352b03-1638-4742-94cc-2f4a54032801', '7bb38318-1c54-46ae-84b8-bb4607fc80e4'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:28 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:28 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-9964314d-b8c4-4cdc-8800-a03cb06da063-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-9964314d-b8c4-4cdc-8800-a03cb06da063-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:29 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-9964314d-b8c4-4cdc-8800-a03cb06da063" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfe45d-749e-41a5-89d4-69f5e4e8ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666f650b-08d3-4e38-be42-e9b09643f89a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278413cc-9526-4aae-90e4-e0a82363ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Volume volume-666f650b-08d3-4e38-be42-e9b09643f89a (666f650b-08d3-4e38-be42-e9b09643f89a): created successfully Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278413cc-9526-4aae-90e4-e0a82363ac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Flow 'volume_create_manager' (c296a873-872b-4471-af5a-4357a6d16f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-9964314d-b8c4-4cdc-8800-a03cb06da063" acquired by "delete_volume" :: waited 0.053s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Flow 'volume_create_manager' (e113227c-bf84-4b48-821a-5af75058f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c83bc21-d8a0-4aeb-a930-c5edb6be77f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1bc8b-32b8-4073-8855-e5663a11b654]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c83bc21-d8a0-4aeb-a930-c5edb6be77f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2120792999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cf0c4d-154f-4c40-8765-de56b8683fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391dba7a97ab4d50b372edef9b0983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8df5da8d-546a-46ce-b186-c223d3a33f29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:29Z,use_quota=True,user_id='2a44afcd58374ee78de7510d9ca85cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e5dc79-7870-41be-b2b6-dde96bbd8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e5dc79-7870-41be-b2b6-dde96bbd8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267f67b8-f0ab-4bb6-8e50-f067cd7a829e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267f67b8-f0ab-4bb6-8e50-f067cd7a829e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3cf0c4d-154f-4c40-8765-de56b8683fee', 'volume_name': 'volume-f3cf0c4d-154f-4c40-8765-de56b8683fee', 'volume_size': 1, 'snapshot_id': '8df5da8d-546a-46ce-b186-c223d3a33f29'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63638cd-9ced-468f-8b40-374e1dafc225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63638cd-9ced-468f-8b40-374e1dafc225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664848ba-b1e3-47cd-9f8d-ac58defff170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Volume f3cf0c4d-154f-4c40-8765-de56b8683fee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3cf0c4d-154f-4c40-8765-de56b8683fee', 'volume_size': 1, 'snapshot_id': '8df5da8d-546a-46ce-b186-c223d3a33f29'} Jul 09 03:06:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-11f7b25a-f198-4e0c-b2a1-72f20cbcda42 tempest-CinderUnicodeTest-1338218211 None] Created volume successfully. Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29-f3cf0c4d-154f-4c40-8765-de56b8683fee" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29-f3cf0c4d-154f-4c40-8765-de56b8683fee" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Creating volume f3cf0c4d-154f-4c40-8765-de56b8683fee from snapshot 8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] snapshot: 8df5da8d-546a-46ce-b186-c223d3a33f29, volume: f3cf0c4d-154f-4c40-8765-de56b8683fee, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:06:29 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 Jul 09 03:06:29 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ace81-5542-40fa-818e-a9218673d78d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:29 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:29 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:29 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.020s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:29 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f9a8e6c8-07e9-4c1e-9f65-e19b6b84493a tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-08c513ed-9c44-4e71-9d6d-60510c077065-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Flow 'volume_create_manager' (559005b2-7cc4-4055-9625-54cf08cb313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7727d186-0f1a-4ebe-abeb-8078036911c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7727d186-0f1a-4ebe-abeb-8078036911c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-859296472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d76e857-0576-48d6-8cb8-7d4f97c8cf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a31e83ed7b4b519f3d5f880ad877f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:31Z,use_quota=True,user_id='ce9ceb5d8c33487dbf7e2093a9228104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a1157a-7627-499e-a5e8-f3709a60ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a1157a-7627-499e-a5e8-f3709a60ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e955d6f5-e6c5-4631-afef-5ce8386f4f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e955d6f5-e6c5-4631-afef-5ce8386f4f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d76e857-0576-48d6-8cb8-7d4f97c8cf4a', 'volume_name': 'volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6299076d-785d-4d35-b695-4cfe80440d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6299076d-785d-4d35-b695-4cfe80440d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317010bb-d064-4f47-9a83-84ab573f1e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Volume 4d76e857-0576-48d6-8cb8-7d4f97c8cf4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a', 'volume_size': 1} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:30 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063" returned: 0 in 1.202s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:30 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063 Jul 09 03:06:30 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:30 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 1.111s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd119f66-d69c-47c8-aece-6887d65ef5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[63183ca1-33f5-4041-86b9-92090d318062]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:31 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:31 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:31 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9964314d-b8c4-4cdc-8800-a03cb06da063" returned: 0 in 0.678s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-9964314d-b8c4-4cdc-8800-a03cb06da063" released by "delete_volume" :: held 1.942s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['d9f05045-df02-4e71-a43b-ad87dbdf2e94', 'eb10d9ff-460b-4496-a53c-dc88deaa8ca8', 'bc812b85-dc43-43bf-be4b-c0e8a17adaab', '12d0eceb-484a-4ec9-a986-de377746b807'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:31 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:31 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-cfae228f-76c9-4a17-b991-39458ab119c2-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-cfae228f-76c9-4a17-b991-39458ab119c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-cfae228f-76c9-4a17-b991-39458ab119c2" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-cfae228f-76c9-4a17-b991-39458ab119c2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleting offline snapshot cfae228f-76c9-4a17-b991-39458ab119c2 of volume 35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] snapshot_file for this snap is: volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c1d51f-76e4-4d8a-9ca9-aef486ff4f6f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:31 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.896s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:06:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:31 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee Jul 09 03:06:31 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:31 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 Jul 09 03:06:31 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:32 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.767s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:32 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f3d532c5-e0c9-4b83-972c-f98804b1a16d tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-9964314d-b8c4-4cdc-8800-a03cb06da063-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:32 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2" returned: 0 in 0.899s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b036159-32d2-4139-887c-2b8aeb6be45c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:32 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 Jul 09 03:06:32 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:34 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770" returned: 0 in 1.391s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:34 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 Jul 09 03:06:34 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:35 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2" returned: 0 in 1.941s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:36 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2 Jul 09 03:06:36 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:37 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770.cfae228f-76c9-4a17-b991-39458ab119c2" returned: 0 in 1.369s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:37 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee" returned: 0 in 5.603s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-cfae228f-76c9-4a17-b991-39458ab119c2" released by "_delete_snapshot" :: held 5.731s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" released by "delete_snapshot" :: held 5.762s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b4bf1-9673-4313-9388-7c4d49bef314]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['ce28b15d-562e-4f86-8bb8-9d0cf47cebe3', 'e4639978-2f48-4c0f-b1d5-23f6f306e692', '31566461-c3ed-4c25-af14-011800ba47c3', 'b84369d9-3b94-43eb-ba27-c13796f9ac39'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:37 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:37 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Delete snapshot completed successfully. Jul 09 03:06:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-fe5acf62-56ce-45ee-8f0e-ae26be51f682 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-cfae228f-76c9-4a17-b991-39458ab119c2-delete_snapshot" released by "delete_snapshot" :: held 5.933s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-35162732-ee2c-48bf-89b6-b1d1e0d6f770-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-35162732-ee2c-48bf-89b6-b1d1e0d6f770-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" acquired by "delete_volume" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658edba-6738-470d-a83b-a89eaddaea08]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:38 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.996s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:06:38 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Converted 1024.00 MB image at 182.72 MB/s Jul 09 03:06:38 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee is being set with open permissions: ugo+rw Jul 09 03:06:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:38 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee Jul 09 03:06:38 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:38 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 Jul 09 03:06:38 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:39 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee" returned: 0 in 0.660s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" released by "_copy_volume_from_snapshot" :: held 9.411s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29-f3cf0c4d-154f-4c40-8765-de56b8683fee" released by "_create_volume_from_snapshot" :: held 9.464s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.504s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.422s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-859296472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d76e857-0576-48d6-8cb8-7d4f97c8cf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a31e83ed7b4b519f3d5f880ad877f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:31Z,use_quota=True,user_id='ce9ceb5d8c33487dbf7e2093a9228104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Creating volume 4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:39 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:39 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a 1073741824 Jul 09 03:06:39 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664848ba-b1e3-47cd-9f8d-ac58defff170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3cf0c4d-154f-4c40-8765-de56b8683fee', 'volume_size': 1, 'snapshot_id': '8df5da8d-546a-46ce-b186-c223d3a33f29'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3b88d9-f128-4d71-88fc-407602d2c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:39 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770" returned: 0 in 0.793s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:39 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Volume volume-f3cf0c4d-154f-4c40-8765-de56b8683fee (f3cf0c4d-154f-4c40-8765-de56b8683fee): created successfully Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3b88d9-f128-4d71-88fc-407602d2c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Flow 'volume_create_manager' (e113227c-bf84-4b48-821a-5af75058f822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:39 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770 Jul 09 03:06:39 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-756ab696-b54f-4401-962b-7ed61bd17b5b tempest-VolumeDependencyTests-571368471 None] Created volume successfully. Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-8df5da8d-546a-46ce-b186-c223d3a33f29-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-8df5da8d-546a-46ce-b186-c223d3a33f29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Deleting offline snapshot 8df5da8d-546a-46ce-b186-c223d3a33f29 of volume bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] snapshot_file for this snap is: volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ac300-b453-48c8-bafc-5500638d60b9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:39 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:39 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:40 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-35162732-ee2c-48bf-89b6-b1d1e0d6f770" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-quobyte-35162732-ee2c-48bf-89b6-b1d1e0d6f770" released by "delete_volume" :: held 1.759s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Created reservations ['3195bd91-9185-4ea7-8d55-1891e3e4c2d6', 'f3c51f5a-d98c-426a-b2cb-59e833d970fe', '259a1e9d-dd4a-4a95-acbb-ca3102f68ca9', 'ee7d4c4e-b46b-4aa1-8cee-d4757f114fad'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:40 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a 1073741824" returned: 0 in 1.061s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:40 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a Jul 09 03:06:40 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:40 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:40 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:40 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 0.949s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd119f66-d69c-47c8-aece-6887d65ef5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b59424-c19a-4834-9921-f5c2c1205376]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:40 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:40 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:40 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.751s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Deleted volume successfully. Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1db11cab-1a13-4217-9032-cbec694aceb7 tempest-CreateVolumesFromSnapshotTest-1007405023 None] Lock "cinder-35162732-ee2c-48bf-89b6-b1d1e0d6f770-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:41 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" returned: 0 in 1.007s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317010bb-d064-4f47-9a83-84ab573f1e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c623da-931b-4991-9a8e-6ad862ffdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Volume volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a (4d76e857-0576-48d6-8cb8-7d4f97c8cf4a): created successfully Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c623da-931b-4991-9a8e-6ad862ffdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Flow 'volume_create_manager' (559005b2-7cc4-4055-9625-54cf08cb313f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b0fcba5d-74a8-4820-a723-9b5b4d55100a tempest-CinderUnicodeTest-1338218211 None] Created volume successfully. Jul 09 03:06:41 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.896s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:41 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:41 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Creating offline snapshot 59e84d4c-7867-4da9-97be-7904a9488c4e of volume 4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[90893ecb-4e74-4aff-bcf8-995918d02c09]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:42 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a Jul 09 03:06:42 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:42 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 0.974s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:42 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29 Jul 09 03:06:42 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:42 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" returned: 0 in 0.874s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:43 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e 1G Jul 09 03:06:43 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:43 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6.8df5da8d-546a-46ce-b186-c223d3a33f29" returned: 0 in 0.769s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-8df5da8d-546a-46ce-b186-c223d3a33f29" released by "_delete_snapshot" :: held 3.740s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" released by "delete_snapshot" :: held 3.777s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Created reservations ['f47e84e1-4730-42c0-9039-3e807f9c820b', 'f3c95ee8-3385-4e85-8e0d-55169ea68291', '33d0ea46-5609-41ff-9e46-564dffdd08bb', '7fb6a3e0-06a2-44b2-a6bd-1974b795ac5b'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Delete snapshot completed successfully. Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a57d0ce9-f110-44a4-8d27-61cb172dd828 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-8df5da8d-546a-46ce-b186-c223d3a33f29-delete_snapshot" released by "delete_snapshot" :: held 3.979s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-bd119f66-d69c-47c8-aece-6887d65ef5f6-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-bd119f66-d69c-47c8-aece-6887d65ef5f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6bc66-b5ff-409f-a520-d32ccf9f0ac6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:44 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:44 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:44 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e 1G" returned: 0 in 1.097s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:44 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e Jul 09 03:06:44 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=135,cinder:UPDATE=172,cinder:INSERT=47,cinder:DELETE=16 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=129,cinder:UPDATE=174,cinder:INSERT=50,cinder:DELETE=16 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (c6a60df0-dccd-4368-ac10-bed8048409de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743fbdad-a96e-4532-b250-1d7e8f9cdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743fbdad-a96e-4532-b250-1d7e8f9cdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128887332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dedf5d8-3562-4103-9ce2-81d5475d9d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:45Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd43d53-f2c3-4a7a-8e9e-9675cca6199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd43d53-f2c3-4a7a-8e9e-9675cca6199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01821459-17ef-4507-b1f7-585d437fa6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01821459-17ef-4507-b1f7-585d437fa6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dedf5d8-3562-4103-9ce2-81d5475d9d61', 'volume_name': 'volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8b51f-744d-4251-a089-d70ffe192e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8b51f-744d-4251-a089-d70ffe192e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2f1b3e-cee5-4487-942e-2e283f687aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:44 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume 6dedf5d8-3562-4103-9ce2-81d5475d9d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61', 'volume_size': 1} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:44 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.877s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:44 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6 Jul 09 03:06:44 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:44 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e" returned: 0 in 0.899s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:44 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e is being set with open permissions: ugo+rw Jul 09 03:06:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:45 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e Jul 09 03:06:45 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:45 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bd119f66-d69c-47c8-aece-6887d65ef5f6" returned: 0 in 0.688s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-bd119f66-d69c-47c8-aece-6887d65ef5f6" released by "delete_volume" :: held 1.654s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Created reservations ['702ff512-91fa-4551-b101-91b22c86e48d', '8cbed782-299a-4bd3-b281-4e62ab06100a', '2e2d9710-2ec9-4c87-805a-ccada1ccc39b', '831fd4e7-c2cc-491c-9296-e178d6f6c09e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:45 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:45 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:45 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:45 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info Jul 09 03:06:45 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-f3cf0c4d-154f-4c40-8765-de56b8683fee-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-f3cf0c4d-154f-4c40-8765-de56b8683fee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d41ae-d6ab-4067-a96d-0c157a829d54]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:46 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee Jul 09 03:06:46 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:46 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:46 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info is being set with open permissions: ugo+rw Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:46 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.782s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:46 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Deleted volume successfully. Jul 09 03:06:46 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info Jul 09 03:06:46 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-caa14f75-9f30-435a-81dd-7bddb2555ee3 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-bd119f66-d69c-47c8-aece-6887d65ef5f6-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:47 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee" returned: 0 in 0.899s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:47 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee Jul 09 03:06:47 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:47 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.info" returned: 0 in 0.790s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.168s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128887332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dedf5d8-3562-4103-9ce2-81d5475d9d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:45Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume 6dedf5d8-3562-4103-9ce2-81d5475d9d61 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:47 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:47 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 1073741824 Jul 09 03:06:47 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:47 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6728dfc9-6e8d-44ea-9421-faf6f37a5bc5 tempest-CinderUnicodeTest-1338218211 None] Create snapshot completed successfully Jul 09 03:06:47 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f3cf0c4d-154f-4c40-8765-de56b8683fee" returned: 0 in 0.685s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-quobyte-f3cf0c4d-154f-4c40-8765-de56b8683fee" released by "delete_volume" :: held 1.648s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Created reservations ['dcd1b0ef-a429-418c-8f10-afd7bbdd4a03', 'bcdbc14e-ae29-4f8d-9fb2-ea6046163ca5', 'ca0eb5b5-debf-4d1b-8c87-48546f6a383a', '733afe86-b2d6-4f9e-a84f-8cc68ae0283a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:47 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:47 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:48 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 1073741824" returned: 0 in 0.895s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:48 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 Jul 09 03:06:48 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-59e84d4c-7867-4da9-97be-7904a9488c4e-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-59e84d4c-7867-4da9-97be-7904a9488c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-quobyte-59e84d4c-7867-4da9-97be-7904a9488c4e" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-59e84d4c-7867-4da9-97be-7904a9488c4e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Deleting offline snapshot 59e84d4c-7867-4da9-97be-7904a9488c4e of volume 4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] snapshot_file for this snap is: volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e024a-22bf-43bd-ab52-1a51530a4675]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:48 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e Jul 09 03:06:48 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:48 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.937s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Deleted volume successfully. Jul 09 03:06:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-39aa4cf6-d05e-45ab-a8ea-535f62362741 tempest-VolumeDependencyTests-571368471 None] Lock "cinder-f3cf0c4d-154f-4c40-8765-de56b8683fee-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:49 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61" returned: 0 in 0.965s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2f1b3e-cee5-4487-942e-2e283f687aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a30b7f3-b6fd-49e3-b7b8-f7158c1fccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 (6dedf5d8-3562-4103-9ce2-81d5475d9d61): created successfully Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a30b7f3-b6fd-49e3-b7b8-f7158c1fccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (c6a60df0-dccd-4368-ac10-bed8048409de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-67094853-cfcc-48c2-ba7f-5a2cadf20278 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:06:49 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e" returned: 0 in 1.048s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa056b0f-e1de-4345-95d2-960fced870fc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:49 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a Jul 09 03:06:49 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (b8721a3b-14d1-4365-a821-38f2d77bd745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e81b531-4cb5-447c-8bd5-ea1448b141e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e81b531-4cb5-447c-8bd5-ea1448b141e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1215584492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:51Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dd31db-6f9f-4d19-af02-34e061ccfb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dd31db-6f9f-4d19-af02-34e061ccfb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f3cfd1-1781-4400-932a-de295758c9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f3cfd1-1781-4400-932a-de295758c9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4', 'volume_name': 'volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9979605-7b83-4a5f-8aa0-be9107c20dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9979605-7b83-4a5f-8aa0-be9107c20dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743285bd-93c0-4c48-91fa-232426d813dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:50 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4', 'volume_size': 1} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1215584492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:51Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:50 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:50 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" returned: 0 in 1.202s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:50 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 1073741824 Jul 09 03:06:50 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:50 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e Jul 09 03:06:50 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (e0c52f29-40a7-43dd-ae08-0d311c9b9ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44770867-bf6e-4cce-b03b-cdabbea7c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44770867-bf6e-4cce-b03b-cdabbea7c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1495516580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:51Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c94ae6-5fe4-4135-b827-087ef99ed33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c94ae6-5fe4-4135-b827-087ef99ed33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03829575-1374-4549-aa85-0a8876677098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03829575-1374-4549-aa85-0a8876677098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579', 'volume_name': 'volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1780eed4-8fa1-42f9-9dcb-95ad0b07afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1780eed4-8fa1-42f9-9dcb-95ad0b07afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20c9221-a66e-43f4-b7ef-5d3c6ac55724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579', 'volume_size': 1} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (28fb7591-7d80-4c42-9977-01a919124768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37288a04-6609-4580-ae2d-8ed9c01c5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37288a04-6609-4580-ae2d-8ed9c01c5353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460832921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b8478e-4b0c-44ea-9218-bdc69f9e67ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ed26a-30bd-4b44-a96c-a68cd7cd4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ed26a-30bd-4b44-a96c-a68cd7cd4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449d088a-4b5c-46e9-b128-b4fb6e8a234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449d088a-4b5c-46e9-b128-b4fb6e8a234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b8478e-4b0c-44ea-9218-bdc69f9e67ac', 'volume_name': 'volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c379e4-1970-48e2-b432-ae434a39e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c379e4-1970-48e2-b432-ae434a39e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d083991-08f2-4f0b-a067-8cf713a8ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume 09b8478e-4b0c-44ea-9218-bdc69f9e67ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac', 'volume_size': 1} Jul 09 03:06:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:52 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e" returned: 0 in 1.363s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:52 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 1073741824" returned: 0 in 1.444s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:52 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e Jul 09 03:06:52 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (1b851322-7c1a-471d-835c-aed7699f9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646434dc-c944-4c38-8c6c-504d79466c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646434dc-c944-4c38-8c6c-504d79466c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145977376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc35f534-3fdb-46eb-96c9-c16ad3232c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efeba30-8b39-4a70-b178-95c4258de923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efeba30-8b39-4a70-b178-95c4258de923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a120c6d-7f1d-4313-b6f7-f778098c6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 Jul 09 03:06:52 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a120c6d-7f1d-4313-b6f7-f778098c6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc35f534-3fdb-46eb-96c9-c16ad3232c7d', 'volume_name': 'volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0499727-f951-4fb4-a0a0-1fe3f84fb9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0499727-f951-4fb4-a0a0-1fe3f84fb9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af5c752-da51-4c36-a3a1-4b6b6c0cd8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:52 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume bc35f534-3fdb-46eb-96c9-c16ad3232c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d', 'volume_size': 1} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (67795082-968b-41e4-8838-a209cf5960ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:52 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614440eb-d071-4b74-b623-41964c9f1c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614440eb-d071-4b74-b623-41964c9f1c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013043423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:53Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d12f411-95ed-4d76-8f58-f8bea357d28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d12f411-95ed-4d76-8f58-f8bea357d28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340d5bfc-f3e2-40ea-9c6b-2259aed6a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340d5bfc-f3e2-40ea-9c6b-2259aed6a39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd', 'volume_name': 'volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56242422-74f8-48de-a807-bb8530430ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56242422-74f8-48de-a807-bb8530430ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367e01b5-90d0-4970-a45a-c00aafd392bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd', 'volume_size': 1} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:53 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a.59e84d4c-7867-4da9-97be-7904a9488c4e" returned: 0 in 1.078s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-59e84d4c-7867-4da9-97be-7904a9488c4e" released by "_delete_snapshot" :: held 4.866s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" released by "delete_snapshot" :: held 4.893s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:53 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" returned: 0 in 0.999s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.044s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1495516580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:51Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:53 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743285bd-93c0-4c48-91fa-232426d813dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 1073741824 Jul 09 03:06:53 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04553240-35f9-4656-9f5e-e5093c49917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:53 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 (e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4): created successfully Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04553240-35f9-4656-9f5e-e5093c49917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (b8721a3b-14d1-4365-a821-38f2d77bd745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c308d0e8-a80b-4077-b16a-fa29dc1416f5 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Created reservations ['4aa78b69-40ea-4605-844e-93b938082299', 'cdee87c2-f61c-40c0-a85e-28c306e95228', '7767d54b-0458-4e8e-b488-2327c4c2817c', '35fcae35-c5f5-4e7a-8544-947b787eadfa'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Delete snapshot completed successfully. Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-dfee6f2b-f688-4203-916e-1117ae34c528 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-59e84d4c-7867-4da9-97be-7904a9488c4e-delete_snapshot" released by "delete_snapshot" :: held 5.189s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fce70f-4749-43a2-8da7-f87a374757b3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:54 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a Jul 09 03:06:54 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:54 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 1073741824" returned: 0 in 1.113s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:54 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 Jul 09 03:06:54 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:54 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" returned: 0 in 0.904s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:54 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a Jul 09 03:06:54 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:55 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460832921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b8478e-4b0c-44ea-9218-bdc69f9e67ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume 09b8478e-4b0c-44ea-9218-bdc69f9e67ac {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:55 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20c9221-a66e-43f4-b7ef-5d3c6ac55724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:55 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac 1073741824 Jul 09 03:06:55 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1fea15-f8a8-4457-b547-e9ef2e7d65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 (e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579): created successfully Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1fea15-f8a8-4457-b547-e9ef2e7d65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (e0c52f29-40a7-43dd-ae08-0d311c9b9ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e2674790-f53a-45c8-ad57-144a3470a563 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:06:55 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" returned: 0 in 0.852s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a" released by "delete_volume" :: held 1.836s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:55 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Created reservations ['61fcaf6d-52c1-4cfc-a061-882a2a547d61', 'b1ee839a-cd65-4124-af31-af26b6d2cf90', '6c9960aa-d23b-404e-9588-023b7a3f3fb0', 'd9630a23-c386-4e79-8171-933b74bf431f'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:56 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:56 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-666f650b-08d3-4e38-be42-e9b09643f89a-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-666f650b-08d3-4e38-be42-e9b09643f89a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "cinder-quobyte-666f650b-08d3-4e38-be42-e9b09643f89a" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-666f650b-08d3-4e38-be42-e9b09643f89a" acquired by "delete_volume" :: waited 0.035s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[80450756-11ab-4009-8c62-e9e1452a05ef]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:56 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a Jul 09 03:06:56 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:56 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac 1073741824" returned: 0 in 1.294s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:56 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac Jul 09 03:06:56 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:57 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.173s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Deleted volume successfully. Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-3476850c-4130-4ffc-b5e3-3cc286ebddc7 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-4d76e857-0576-48d6-8cb8-7d4f97c8cf4a-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:57 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a" returned: 0 in 1.069s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:57 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a Jul 09 03:06:57 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:57 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" returned: 0 in 0.909s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.193s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145977376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc35f534-3fdb-46eb-96c9-c16ad3232c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:52Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume bc35f534-3fdb-46eb-96c9-c16ad3232c7d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:57 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:57 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d 1073741824 Jul 09 03:06:57 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d083991-08f2-4f0b-a067-8cf713a8ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94cb218-743f-45a9-b31f-be2648b6716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:57 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac (09b8478e-4b0c-44ea-9218-bdc69f9e67ac): created successfully Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94cb218-743f-45a9-b31f-be2648b6716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (28fb7591-7d80-4c42-9977-01a919124768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-18386876-2d7a-4643-bde7-6c874dea5bfb tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:06:58 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-666f650b-08d3-4e38-be42-e9b09643f89a" returned: 0 in 0.871s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-quobyte-666f650b-08d3-4e38-be42-e9b09643f89a" released by "delete_volume" :: held 2.002s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Created reservations ['dd0a769c-a9ca-4ca8-bec5-a47d131d54b9', 'b32bae48-9c2b-4c64-8589-434801ee1107', '23d3f6d0-c043-436b-8068-05aee38483fd', '1485003a-c2f8-4f5d-b952-20466d060003'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:58 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:06:58 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:58 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d 1073741824" returned: 0 in 1.158s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:58 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d Jul 09 03:06:58 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:59 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.781s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:06:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Deleted volume successfully. Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-13b92b01-59c8-4850-9608-ed824dafa1c1 tempest-CinderUnicodeTest-1338218211 None] Lock "cinder-666f650b-08d3-4e38-be42-e9b09643f89a-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:06:59 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" returned: 0 in 0.879s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.696s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013043423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce02f0aee174389872af12a8b0e7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:06:53Z,use_quota=True,user_id='eed3a49e9aa148a89c0390d2a034b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Creating volume b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:06:59 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:06:59 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd 1073741824 Jul 09 03:06:59 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af5c752-da51-4c36-a3a1-4b6b6c0cd8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984050e8-d2b2-4bfa-b8d3-6d1f39548270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:06:59 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d (bc35f534-3fdb-46eb-96c9-c16ad3232c7d): created successfully Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984050e8-d2b2-4bfa-b8d3-6d1f39548270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:06:59 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (1b851322-7c1a-471d-835c-aed7699f9221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:06:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4f9ec221-a01a-44bb-82f9-7d9fcb3b21f4 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Flow 'volume_create_manager' (3984db93-4ff6-4a93-8947-23dc0f0810fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbac6ddf-4f22-4a93-a972-39d4f4ccf5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbac6ddf-4f22-4a93-a972-39d4f4ccf5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362566446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69960f1-f5e3-4dff-bb68-e55d4b5587b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523abb1bae9a4002b807828675daf40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:00Z,use_quota=True,user_id='4cf4a4c937e14f3b94b2bb75ef592cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc79a9c0-345d-4aad-8ac7-d3c1cc467baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc79a9c0-345d-4aad-8ac7-d3c1cc467baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048ddb84-1406-44d9-8767-be8b0496cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048ddb84-1406-44d9-8767-be8b0496cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69960f1-f5e3-4dff-bb68-e55d4b5587b0', 'volume_name': 'volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12453c5e-58a8-44d5-8200-23f71fa48eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12453c5e-58a8-44d5-8200-23f71fa48eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc8442-e914-4de0-91c2-adf528e213f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:00 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Volume e69960f1-f5e3-4dff-bb68-e55d4b5587b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0', 'volume_size': 1} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:00 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd 1073741824" returned: 0 in 1.027s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:00 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd Jul 09 03:07:00 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:01 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" returned: 0 in 0.776s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362566446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69960f1-f5e3-4dff-bb68-e55d4b5587b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523abb1bae9a4002b807828675daf40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:00Z,use_quota=True,user_id='4cf4a4c937e14f3b94b2bb75ef592cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Creating volume e69960f1-f5e3-4dff-bb68-e55d4b5587b0 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:01 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:01 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 1073741824 Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367e01b5-90d0-4970-a45a-c00aafd392bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:01 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b1459-696c-45ad-98fa-cbbc71567837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:01 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Volume volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd (b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd): created successfully Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b1459-696c-45ad-98fa-cbbc71567837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:01 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Flow 'volume_create_manager' (67795082-968b-41e4-8838-a209cf5960ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b3e63d99-884b-47c8-8458-128bc1712bee tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created volume successfully. Jul 09 03:07:02 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 1073741824" returned: 0 in 0.978s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:02 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 Jul 09 03:07:02 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abdaab0-1dae-434e-869c-e77f281964a1]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:03 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd Jul 09 03:07:03 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:03 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" returned: 0 in 0.926s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc8442-e914-4de0-91c2-adf528e213f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e01508-c8df-4a4d-afab-11851115dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:03 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Volume volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 (e69960f1-f5e3-4dff-bb68-e55d4b5587b0): created successfully Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e01508-c8df-4a4d-afab-11851115dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Flow 'volume_create_manager' (3984db93-4ff6-4a93-8947-23dc0f0810fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-dd1c0ddd-5b82-448c-9cf1-aed2b4459036 tempest-ProjectReaderTests-1309403918 None] Created volume successfully. Jul 09 03:07:04 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" returned: 0 in 0.924s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:04 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd Jul 09 03:07:04 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:04 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" returned: 0 in 0.808s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd" released by "delete_volume" :: held 1.810s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Acquiring lock "cinder-e69960f1-f5e3-4dff-bb68-e55d4b5587b0-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "cinder-e69960f1-f5e3-4dff-bb68-e55d4b5587b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Acquiring lock "cinder-quobyte-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['837543cd-82bb-44e5-a7d9-5d4670a59d19', '38db77ec-18a3-4edd-9956-27db1c367612', 'c8f8c759-67dc-4a2b-8bf6-23fe5554bd3a', '066f8c04-26b3-4c95-8663-62027cb5b556'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "cinder-quobyte-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f7951-6be4-4689-aaf8-a80c03e5bbae]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:05 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 Jul 09 03:07:05 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-bc35f534-3fdb-46eb-96c9-c16ad3232c7d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-bc35f534-3fdb-46eb-96c9-c16ad3232c7d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a18556-4a88-4079-828a-29fe6211ac97]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:05 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d Jul 09 03:07:05 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:05 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.823s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-848504ee-514a-4687-a60e-0b42f80c28f1 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-b8881fc4-dfe9-42bc-a0b0-7bf1548a21cd-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:06 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" returned: 0 in 1.256s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:06 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0 Jul 09 03:07:06 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:06 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" returned: 0 in 1.155s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:06 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d Jul 09 03:07:06 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:07 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" returned: 0 in 0.934s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "cinder-quobyte-e69960f1-f5e3-4dff-bb68-e55d4b5587b0" released by "delete_volume" :: held 2.235s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Created reservations ['a3045043-38e3-4a9a-8657-4a6417101636', '41bf1b10-0e97-445f-8836-adfb4570a1d9', 'aa0e042b-aa26-45d5-809d-25f2e9f12d65', '1632df4b-3241-4ed2-88c3-27032946e88a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:07 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" returned: 0 in 0.755s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-bc35f534-3fdb-46eb-96c9-c16ad3232c7d" released by "delete_volume" :: held 1.972s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:07 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:07 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['62071759-4abd-424e-8ea5-96d458b097d0', 'd7dfa4ed-ead9-4ae1-a1d6-998132b25e2f', 'dad57126-691b-424e-8e19-4de8425b9891', '4fd2f31c-3352-46a5-9502-6004c127c533'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:07 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:07 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:08 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.729s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Deleted volume successfully. Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61338db0-ae8a-4c61-9676-54b6b41f082a tempest-ProjectReaderTests-1309403918 None] Lock "cinder-e69960f1-f5e3-4dff-bb68-e55d4b5587b0-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:08 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.789s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:08 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-410302fc-4aa3-4cad-a0d4-d1ef7b025047 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-bc35f534-3fdb-46eb-96c9-c16ad3232c7d-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-09b8478e-4b0c-44ea-9218-bdc69f9e67ac-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-09b8478e-4b0c-44ea-9218-bdc69f9e67ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c3f55b-3723-4bb3-a97f-7c99e91fcecc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:08 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac Jul 09 03:07:08 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Flow 'volume_create_manager' (474f6d7d-1a26-4895-ae89-4276c569703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afb33c-e17c-44a2-8249-d31802e9f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afb33c-e17c-44a2-8249-d31802e9f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317445336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57eede83-3e25-4a67-ae41-4b8ea61d6481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523abb1bae9a4002b807828675daf40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:09Z,use_quota=True,user_id='4cf4a4c937e14f3b94b2bb75ef592cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422004c6-770a-484f-908f-faf98530c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422004c6-770a-484f-908f-faf98530c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db82605b-36a2-4cf7-bfce-6a91fd04b761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db82605b-36a2-4cf7-bfce-6a91fd04b761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57eede83-3e25-4a67-ae41-4b8ea61d6481', 'volume_name': 'volume-57eede83-3e25-4a67-ae41-4b8ea61d6481', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2c939b-c57f-4b8e-876f-8e3e25a126a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2c939b-c57f-4b8e-876f-8e3e25a126a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879523fd-a26d-4d82-b958-4ad70f280875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:09 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Volume 57eede83-3e25-4a67-ae41-4b8ea61d6481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57eede83-3e25-4a67-ae41-4b8ea61d6481', 'volume_size': 1} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317445336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57eede83-3e25-4a67-ae41-4b8ea61d6481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523abb1bae9a4002b807828675daf40d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:09Z,use_quota=True,user_id='4cf4a4c937e14f3b94b2bb75ef592cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Creating volume 57eede83-3e25-4a67-ae41-4b8ea61d6481 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:09 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:09 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 1073741824 Jul 09 03:07:09 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:09 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:09 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac Jul 09 03:07:09 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:10 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 1073741824" returned: 0 in 1.064s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:10 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 Jul 09 03:07:10 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:10 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" returned: 0 in 0.979s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-09b8478e-4b0c-44ea-9218-bdc69f9e67ac" released by "delete_volume" :: held 1.886s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['2474a01d-56a1-4413-9edb-79723c7a49c4', '8f3c08da-c193-4ba9-8629-0d1ee99b9e04', '89b758f8-31b2-4e9d-808a-a1cb7dcf4f7e', 'f80db2ff-1f98-4c1e-a669-0ccd0aa6ffe2'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:10 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:10 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:11 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481" returned: 0 in 0.921s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" acquired by "delete_volume" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879523fd-a26d-4d82-b958-4ad70f280875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57eede83-3e25-4a67-ae41-4b8ea61d6481', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fcdce3-0117-4a24-ae56-c991a5b9c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[701aa9a8-1fad-402d-bbc7-a23322d0a66d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Volume volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 (57eede83-3e25-4a67-ae41-4b8ea61d6481): created successfully Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fcdce3-0117-4a24-ae56-c991a5b9c41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Flow 'volume_create_manager' (474f6d7d-1a26-4895-ae89-4276c569703a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-faed2a58-f7e4-41af-aa8a-d288e5324804 tempest-ProjectReaderTests-1309403918 None] Created volume successfully. Jul 09 03:07:11 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 Jul 09 03:07:11 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:11 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.018s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:11 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-a4025c47-ab5b-424f-a196-1e9aebc4e355 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-09b8478e-4b0c-44ea-9218-bdc69f9e67ac-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "cinder-57eede83-3e25-4a67-ae41-4b8ea61d6481-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "cinder-57eede83-3e25-4a67-ae41-4b8ea61d6481-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:12 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" returned: 0 in 1.067s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:12 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579 Jul 09 03:07:12 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "cinder-quobyte-57eede83-3e25-4a67-ae41-4b8ea61d6481" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "cinder-quobyte-57eede83-3e25-4a67-ae41-4b8ea61d6481" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b91fb1-0269-4ef0-a0fc-dc2255949242]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:12 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 Jul 09 03:07:12 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:13 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579" released by "delete_volume" :: held 1.936s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['90d55b0f-d269-4d73-a7ba-7e402f1dcb12', '3735532c-9563-497f-b5e5-d41a46e41e28', '63503834-dfdf-4192-83cc-8eabf5fba00e', '19862c5d-5f55-42c3-bb39-622fc6d6a812'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:13 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:13 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:13 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481" returned: 0 in 0.971s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:13 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481 Jul 09 03:07:13 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1748f692-de4c-48e5-902e-ff8d7e451d8c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:13 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 Jul 09 03:07:13 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:14 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-57eede83-3e25-4a67-ae41-4b8ea61d6481" returned: 0 in 0.833s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "cinder-quobyte-57eede83-3e25-4a67-ae41-4b8ea61d6481" released by "delete_volume" :: held 1.858s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Created reservations ['9726ba65-5d36-4bf0-89ec-5ce0d6f73efd', '72b57e7a-5680-49a9-9a15-b4874fed0d0a', 'd4bb98ae-bf39-404c-b181-cba9208040b2', '84417e48-a68e-4eb8-8b2b-ae3e67488f6a'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:14 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.093s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:14 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9f0f015b-a3f6-4989-9b4c-7b5f0f73d7d0 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-e3dabc1f-66c9-4ff1-9edd-8fb0e2a57579-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:14 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:14 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:14 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" returned: 0 in 1.139s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:14 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4 Jul 09 03:07:14 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:15 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.867s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:15 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Deleted volume successfully. Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06de1b13-92f8-4223-95c2-bea9a9df5b41 tempest-ProjectReaderTests-1309403918 None] Lock "cinder-57eede83-3e25-4a67-ae41-4b8ea61d6481-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:15 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" returned: 0 in 1.022s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4" released by "delete_volume" :: held 2.240s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:15 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['546e8898-6723-4910-bbca-3bcc87c5bc12', '24ffaf85-90fc-4de1-949c-7057c4f94d99', 'a5b9ae0d-0f10-4acf-aca7-86fa38492e52', '5180dae9-313e-4acb-9b44-637cb382fc1d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:16 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:16 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:16 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.754s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-c788971b-4641-4c11-bd1d-2083e68f6594 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-e2c03cdd-e8b0-4452-aa7b-5783e2ed1ff4-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-6dedf5d8-3562-4103-9ce2-81d5475d9d61-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-6dedf5d8-3562-4103-9ce2-81d5475d9d61-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "cinder-quobyte-6dedf5d8-3562-4103-9ce2-81d5475d9d61" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-6dedf5d8-3562-4103-9ce2-81d5475d9d61" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560b49c-e3d0-4f00-94a2-f667a3a7af38]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:17 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 Jul 09 03:07:17 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:17 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61" returned: 0 in 0.868s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:17 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61 Jul 09 03:07:17 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:18 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-6dedf5d8-3562-4103-9ce2-81d5475d9d61" returned: 0 in 0.730s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-quobyte-6dedf5d8-3562-4103-9ce2-81d5475d9d61" released by "delete_volume" :: held 1.661s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Created reservations ['e668adff-2db6-4aae-8fad-96b859fc5616', '332baf1e-b72d-4492-addf-ea6fc90313ab', 'aec8eab4-9ff6-49f5-ad21-3fdd374c9aae', '1e7b9c35-d971-4045-929a-85233b3b6f15'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:18 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:18 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:19 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.674s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:19 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:19 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Deleted volume successfully. Jul 09 03:07:19 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-97311061-1fd3-42ed-9964-201c58a75925 tempest-CreateVolumesFromSourceVolumeTest-213672303 None] Lock "cinder-6dedf5d8-3562-4103-9ce2-81d5475d9d61-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:23 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:23 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (4593dc87-45dd-4a64-8f1f-f161f1865324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922b8488-d31a-431d-97bd-a0713ee01239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922b8488-d31a-431d-97bd-a0713ee01239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384996037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff66a297-d814-4060-90d1-5b589e2b1c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:24Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9dd273-243d-4d47-9aaf-9b479960e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9dd273-243d-4d47-9aaf-9b479960e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfa1973-fc9d-4fcd-9b11-170522b39864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfa1973-fc9d-4fcd-9b11-170522b39864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff66a297-d814-4060-90d1-5b589e2b1c30', 'volume_name': 'volume-ff66a297-d814-4060-90d1-5b589e2b1c30', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f4ece1-612c-4754-b465-e74d7e20b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f4ece1-612c-4754-b465-e74d7e20b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cd636-3f13-42bb-9474-757c3eb66bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Volume ff66a297-d814-4060-90d1-5b589e2b1c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff66a297-d814-4060-90d1-5b589e2b1c30', 'volume_size': 1} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384996037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff66a297-d814-4060-90d1-5b589e2b1c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:24Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Creating volume ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:24 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:24 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 1073741824 Jul 09 03:07:24 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:25 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 1073741824" returned: 0 in 0.933s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:25 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 Jul 09 03:07:25 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (17ee57da-3310-47f6-8bd4-9e349d79e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e2658-28f1-4409-800f-d38c305e2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e2658-28f1-4409-800f-d38c305e2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725655837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdf9f01-57aa-4066-b569-9e6ef8cb76b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:25Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ded7fcf-f600-487d-aaea-a25d177e6f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ded7fcf-f600-487d-aaea-a25d177e6f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8034b6-baaa-40b0-8ecb-c8b810048a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8034b6-baaa-40b0-8ecb-c8b810048a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdf9f01-57aa-4066-b569-9e6ef8cb76b2', 'volume_name': 'volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e201b9db-876e-4bb6-a0e6-3583d3f53fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e201b9db-876e-4bb6-a0e6-3583d3f53fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce37e2a-4d04-45c6-ab8f-f988f5855d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Volume dcdf9f01-57aa-4066-b569-9e6ef8cb76b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2', 'volume_size': 1} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:25 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30" returned: 0 in 0.824s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725655837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdf9f01-57aa-4066-b569-9e6ef8cb76b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:25Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Creating volume dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:25 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872cd636-3f13-42bb-9474-757c3eb66bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff66a297-d814-4060-90d1-5b589e2b1c30', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 1073741824 Jul 09 03:07:25 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f038574-84ac-478a-a58a-d89a3ae3f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Volume volume-ff66a297-d814-4060-90d1-5b589e2b1c30 (ff66a297-d814-4060-90d1-5b589e2b1c30): created successfully Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f038574-84ac-478a-a58a-d89a3ae3f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (4593dc87-45dd-4a64-8f1f-f161f1865324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e5a8ddcc-3af8-44ad-913b-6501068296f6 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Flow 'volume_create_manager' (0299666b-9de1-4da8-9f29-53f9fd5028d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdaddcb-5042-4614-8d9b-cd85a0d271ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdaddcb-5042-4614-8d9b-cd85a0d271ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-368775282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd1664c8cd4d709cdb39b68614eaed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:26Z,use_quota=True,user_id='dc4733a7c8e74616aae15de2970c645f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1dd5b0-a565-4a2a-a9bb-bb2aa82b59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1dd5b0-a565-4a2a-a9bb-bb2aa82b59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043d004-8bc8-43bb-901b-e0360893240b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043d004-8bc8-43bb-901b-e0360893240b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c', 'volume_name': 'volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac1a3e-15a7-4ab7-bd2d-65f5f4ad4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac1a3e-15a7-4ab7-bd2d-65f5f4ad4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9db14b8-13c9-43ef-8e80-fa00b8a2c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:26 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Volume 9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c', 'volume_size': 1} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:26 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 1073741824" returned: 0 in 0.830s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:26 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 Jul 09 03:07:26 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:27 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" returned: 0 in 0.676s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-368775282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd1664c8cd4d709cdb39b68614eaed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:26Z,use_quota=True,user_id='dc4733a7c8e74616aae15de2970c645f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Creating volume 9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:27 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:27 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c 1073741824 Jul 09 03:07:27 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce37e2a-4d04-45c6-ab8f-f988f5855d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aac8c5-bb8c-4d1f-9689-e27c78e66cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:27 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Volume volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 (dcdf9f01-57aa-4066-b569-9e6ef8cb76b2): created successfully Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aac8c5-bb8c-4d1f-9689-e27c78e66cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (17ee57da-3310-47f6-8bd4-9e349d79e445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:27 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f8418249-7cef-4f00-8d18-b930fe0b34f0 tempest-ProjectReaderTests-592133543 None] Created volume successfully. Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:27 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:27 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:28 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c 1073741824" returned: 0 in 0.901s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:28 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:28 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:28 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.820s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "cinder-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-quobyte-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a855f03e-de1d-44ec-bc34-fef905ed2266]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:29 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 Jul 09 03:07:29 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:29 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.750s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.644s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Creating offline snapshot d7ffcd38-73c7-40ea-8f28-20a0fa921acc of volume ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9db14b8-13c9-43ef-8e80-fa00b8a2c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6dadfd-8744-4876-b543-ff0bb4423ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[23066b13-313f-476c-a410-b9312c6336c6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:29 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Volume volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c (9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c): created successfully Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6dadfd-8744-4876-b543-ff0bb4423ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Flow 'volume_create_manager' (0299666b-9de1-4da8-9f29-53f9fd5028d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:29 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e9c1b5f6-0e9d-4ceb-ad46-6840dce30f64 tempest-SnapshotDependencyTests-2145355828 None] Created volume successfully. Jul 09 03:07:29 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 Jul 09 03:07:29 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:30 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:30 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" returned: 0 in 1.017s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30" returned: 0 in 0.809s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:30 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2 Jul 09 03:07:30 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:30 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc 1G Jul 09 03:07:30 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:30 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" returned: 0 in 0.652s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2" released by "delete_volume" :: held 1.734s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Created reservations ['7cf95af1-1a93-4aa3-b3bf-84f8d727c994', '137aa7f0-00eb-4105-a676-71af75ff49d2', '1ac72fc6-4d0a-4db7-86cf-17c228d431b8', '039ec0b3-7718-4554-a56c-af26f2ea691c'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:30 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:30 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc 1G" returned: 0 in 0.852s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff66a297-d814-4060-90d1-5b589e2b1c30 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:30 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:30 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff66a297-d814-4060-90d1-5b589e2b1c30 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc Jul 09 03:07:30 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:31 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.702s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:31 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Deleted volume successfully. Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-752722fa-f334-40d9-86ad-7082d709ea17 tempest-ProjectReaderTests-592133543 None] Lock "cinder-dcdf9f01-57aa-4066-b569-9e6ef8cb76b2-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:31 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff66a297-d814-4060-90d1-5b589e2b1c30 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc" returned: 0 in 0.712s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:31 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc is being set with open permissions: ugo+rw Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:31 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc Jul 09 03:07:31 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (b39bcf51-6f03-4780-9866-bc8c967f1066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dd2139-756e-4ae0-bc65-6eeb527b7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dd2139-756e-4ae0-bc65-6eeb527b7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794440551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3f494-297f-4d42-a99d-55f96e26f812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:32Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df156d-660c-4330-bdd6-28cccadcdf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df156d-660c-4330-bdd6-28cccadcdf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2c085e-fe94-44b2-bca1-c13d671960d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2c085e-fe94-44b2-bca1-c13d671960d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a3f494-297f-4d42-a99d-55f96e26f812', 'volume_name': 'volume-a6a3f494-297f-4d42-a99d-55f96e26f812', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f98c5b7-98eb-4107-a8a9-019537127896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f98c5b7-98eb-4107-a8a9-019537127896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f848d253-b37b-4bae-b6a5-acf35f813e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:31 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Volume a6a3f494-297f-4d42-a99d-55f96e26f812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a3f494-297f-4d42-a99d-55f96e26f812', 'volume_size': 1} Jul 09 03:07:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:32 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc" returned: 0 in 0.642s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:32 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info Jul 09 03:07:32 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:32 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info" returned: 0 in 0.624s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:32 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info is being set with open permissions: ugo+rw Jul 09 03:07:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:32 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info Jul 09 03:07:32 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:33 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.info" returned: 0 in 0.610s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.674s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Creating offline snapshot e9a9dcc1-a604-4d73-9aa1-5a17ae664981 of volume 9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d59bb27-87af-4d89-a396-342684051545]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:33 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bb7eccea-c73e-4551-9917-d8012f56a975 tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:07:33 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:33 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-d7ffcd38-73c7-40ea-8f28-20a0fa921acc-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-d7ffcd38-73c7-40ea-8f28-20a0fa921acc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-d7ffcd38-73c7-40ea-8f28-20a0fa921acc" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-d7ffcd38-73c7-40ea-8f28-20a0fa921acc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot d7ffcd38-73c7-40ea-8f28-20a0fa921acc of volume ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9271d380-385f-4733-859b-bb0510245cd9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:34 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc Jul 09 03:07:34 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:34 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.805s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:34 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 1G Jul 09 03:07:34 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:34 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff66a297-d814-4060-90d1-5b589e2b1c30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf70ab-29ea-40d5-925a-0aa6c1ece13a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:34 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 Jul 09 03:07:34 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:35 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 1G" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:35 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:35 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:35 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30" returned: 0 in 0.764s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:35 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc Jul 09 03:07:35 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:35 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:35 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 is being set with open permissions: ugo+rw Jul 09 03:07:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:36 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc" returned: 0 in 0.735s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc Jul 09 03:07:36 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:36 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info Jul 09 03:07:36 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:36 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30.d7ffcd38-73c7-40ea-8f28-20a0fa921acc" returned: 0 in 0.644s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-d7ffcd38-73c7-40ea-8f28-20a0fa921acc" released by "_delete_snapshot" :: held 3.110s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" released by "delete_snapshot" :: held 3.133s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Created reservations ['839fceec-14e5-4ac3-8fdf-3f72e0d90da9', '5ebc2822-2550-455f-a5d0-071ce803bdb3', 'e8f46b50-a623-45f0-9486-a5e595ddac87', 'd98169dd-66b9-4b9b-a110-d065a3b2e840'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:37 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:07:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d02e4ce7-5e0c-4e76-b518-7d0fd907519b tempest-ProjectMemberTests-219285624 None] Lock "cinder-d7ffcd38-73c7-40ea-8f28-20a0fa921acc-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:37 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:37 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info is being set with open permissions: ugo+rw Jul 09 03:07:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:37 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info Jul 09 03:07:37 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:37 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.info" returned: 0 in 0.625s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.457s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794440551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a3f494-297f-4d42-a99d-55f96e26f812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:32Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Creating volume a6a3f494-297f-4d42-a99d-55f96e26f812 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:38 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 1073741824 Jul 09 03:07:38 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-ff66a297-d814-4060-90d1-5b589e2b1c30-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-081cddff-b4bf-4755-b7ad-a1a317937307 tempest-SnapshotDependencyTests-2145355828 None] Create snapshot completed successfully Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "cinder-ff66a297-d814-4060-90d1-5b589e2b1c30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[be150015-0cc8-4bf8-a0d5-dde4b3fc0d2f]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:38 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 Jul 09 03:07:38 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Flow 'volume_create_manager' (c3dcc2a2-40ff-48be-b48e-9b4bb30ededf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278a7f01-23ab-4964-bf10-e81bdb9815cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278a7f01-23ab-4964-bf10-e81bdb9815cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e284fc-83d1-471b-a638-a4d3ca116cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd1664c8cd4d709cdb39b68614eaed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9a9dcc1-a604-4d73-9aa1-5a17ae664981,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:39Z,use_quota=True,user_id='dc4733a7c8e74616aae15de2970c645f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8c3d05-5699-4429-ba77-4740e02995ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8c3d05-5699-4429-ba77-4740e02995ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588afd00-20c1-419f-893b-e70d31254965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588afd00-20c1-419f-893b-e70d31254965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58e284fc-83d1-471b-a638-a4d3ca116cc4', 'volume_name': 'volume-58e284fc-83d1-471b-a638-a4d3ca116cc4', 'volume_size': 1, 'snapshot_id': 'e9a9dcc1-a604-4d73-9aa1-5a17ae664981'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acb9051-f79b-4cc0-bb17-d5c908c8827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acb9051-f79b-4cc0-bb17-d5c908c8827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9fca1d-e78f-44c4-9e80-a61f7367eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Volume 58e284fc-83d1-471b-a638-a4d3ca116cc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58e284fc-83d1-471b-a638-a4d3ca116cc4', 'volume_size': 1, 'snapshot_id': 'e9a9dcc1-a604-4d73-9aa1-5a17ae664981'} Jul 09 03:07:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 1073741824" returned: 0 in 1.001s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30" returned: 0 in 0.829s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:39 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30 Jul 09 03:07:39 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:39 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 Jul 09 03:07:39 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:39 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-ff66a297-d814-4060-90d1-5b589e2b1c30" returned: 0 in 0.628s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-ff66a297-d814-4060-90d1-5b589e2b1c30" released by "delete_volume" :: held 1.524s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Created reservations ['c4741c24-fd89-4d06-9958-bb9f8bddc923', 'aa2950e8-efc8-4e02-a07b-96014e7c00e0', '4e821320-6b0d-4f9c-a6e0-c890f783b0a6', '81babbf3-f5f4-4145-bf8e-c0d9bc676419'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:39 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.809s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-58e284fc-83d1-471b-a638-a4d3ca116cc4" by "_create_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f848d253-b37b-4bae-b6a5-acf35f813e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a3f494-297f-4d42-a99d-55f96e26f812', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b01e6-8b4f-4a14-bc71-e6dfa15a5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-58e284fc-83d1-471b-a638-a4d3ca116cc4" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Creating volume 58e284fc-83d1-471b-a638-a4d3ca116cc4 from snapshot e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" by "_copy_volume_from_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] snapshot: e9a9dcc1-a604-4d73-9aa1-5a17ae664981, volume: 58e284fc-83d1-471b-a638-a4d3ca116cc4, {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 03:07:39 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:39 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:39 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Volume volume-a6a3f494-297f-4d42-a99d-55f96e26f812 (a6a3f494-297f-4d42-a99d-55f96e26f812): created successfully Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4b01e6-8b4f-4a14-bc71-e6dfa15a5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (b39bcf51-6f03-4780-9866-bc8c967f1066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9e7d369d-9d03-46c1-b0d6-34934fdce0a7 tempest-ProjectReaderTests-592133543 None] Created volume successfully. Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6239462-6fcd-4455-b76a-98d2ed139637]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:40 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:40 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-a6a3f494-297f-4d42-a99d-55f96e26f812-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "cinder-a6a3f494-297f-4d42-a99d-55f96e26f812-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-quobyte-a6a3f494-297f-4d42-a99d-55f96e26f812" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-a6a3f494-297f-4d42-a99d-55f96e26f812" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[d585b661-8c6f-4bc1-8f28-5dfedd0ad7f3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:40 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 Jul 09 03:07:40 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:40 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.858s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94a6f7e7-0ee2-4385-8cd5-55b2516274ae tempest-ProjectMemberTests-219285624 None] Lock "cinder-ff66a297-d814-4060-90d1-5b589e2b1c30-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (794dc912-595c-4597-a184-3721bdefb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3184c-1e30-4e87-a6a3-f093ebcd2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3184c-1e30-4e87-a6a3-f093ebcd2277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645366440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fb0ffc-3590-422a-8276-451aef9908f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:41Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe73298-9e4e-4d99-b107-babaebeab996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe73298-9e4e-4d99-b107-babaebeab996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eed6ea0-3f71-4b49-a53b-8fa7091b5360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eed6ea0-3f71-4b49-a53b-8fa7091b5360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fb0ffc-3590-422a-8276-451aef9908f1', 'volume_name': 'volume-76fb0ffc-3590-422a-8276-451aef9908f1', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe38b19-8084-4e36-ac95-b75062f1fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe38b19-8084-4e36-ac95-b75062f1fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fcf81b-d673-4056-9b1d-004a08f77e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:40 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Volume 76fb0ffc-3590-422a-8276-451aef9908f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fb0ffc-3590-422a-8276-451aef9908f1', 'volume_size': 1} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:40 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 1.007s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Creating direct copy from snapshot {{(pid=87156) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db6b7a-354a-498e-938a-b9836ab2e890]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:41 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:41 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:41 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812" returned: 0 in 0.954s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:41 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812 Jul 09 03:07:41 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:41 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.758s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:41 devstack cinder-volume[87156]: DEBUG cinder.utils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Path /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 not found in is_blk_device check {{(pid=87156) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 03:07:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:41 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 Jul 09 03:07:41 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:42 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a6a3f494-297f-4d42-a99d-55f96e26f812" returned: 0 in 0.762s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-a6a3f494-297f-4d42-a99d-55f96e26f812" released by "delete_volume" :: held 1.779s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Created reservations ['ed3f3cf5-3ed0-42db-b7c7-4848b428d4a3', '5424e81a-0c50-4031-bc84-78eea34b68c0', '3142173c-8da5-44bf-84bb-484bbea13754', '26e40c15-3df7-4792-96db-d86a9456ac04'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:42 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:42 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (1ab4ee39-871b-42f9-a570-fd80cb9c48bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbdd24c-21fd-4218-87ab-4280464bf63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 1.276s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Deleted volume successfully. Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbdd24c-21fd-4218-87ab-4280464bf63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667025386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd3df7-c991-4c65-a2fc-8f64221ca8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:43Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41eb9b63-4edf-4fca-843d-9e517dde4e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41eb9b63-4edf-4fca-843d-9e517dde4e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d0ff6d-5910-4766-beab-1815589847f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d0ff6d-5910-4766-beab-1815589847f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cd3df7-c991-4c65-a2fc-8f64221ca8bb', 'volume_name': 'volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296eaf61-1dd8-473c-bb58-b4de3584b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296eaf61-1dd8-473c-bb58-b4de3584b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45d4f1f-94cc-44b4-8ece-6e98c1074fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Volume 51cd3df7-c991-4c65-a2fc-8f64221ca8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb', 'volume_size': 1} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:43 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-bdef1ca4-ff3d-44aa-ae12-d7e16a287ee4 tempest-ProjectReaderTests-592133543 None] Lock "cinder-a6a3f494-297f-4d42-a99d-55f96e26f812-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:45 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=125,cinder:INSERT=38,cinder:UPDATE=178,cinder:DELETE=16 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:07:45 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=120,cinder:INSERT=45,cinder:UPDATE=166,cinder:DELETE=14 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:07:46 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4" returned: 0 in 4.825s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea77e62-d738-46aa-b2f3-090f1dc729be]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:46 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:46 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:47 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.965s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:47 devstack cinder-volume[87156]: DEBUG cinder.image.image_utils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Image conversion details: src /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 {{(pid=87156) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 03:07:47 devstack cinder-volume[87156]: INFO cinder.image.image_utils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Converted 1024.00 MB image at 212.19 MB/s Jul 09 03:07:47 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 is being set with open permissions: ugo+rw Jul 09 03:07:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:47 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 Jul 09 03:07:47 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:48 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4" returned: 0 in 0.638s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" released by "_copy_volume_from_snapshot" :: held 8.303s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-58e284fc-83d1-471b-a638-a4d3ca116cc4" released by "_create_volume_from_snapshot" :: held 8.352s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.392s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.291s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645366440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fb0ffc-3590-422a-8276-451aef9908f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:41Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Creating volume 76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:48 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:48 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 1073741824 Jul 09 03:07:48 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9fca1d-e78f-44c4-9e80-a61f7367eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e284fc-83d1-471b-a638-a4d3ca116cc4', 'volume_size': 1, 'snapshot_id': 'e9a9dcc1-a604-4d73-9aa1-5a17ae664981'}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acecc7fe-7973-494e-85b1-44aabe3b4a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:48 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Volume volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 (58e284fc-83d1-471b-a638-a4d3ca116cc4): created successfully Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acecc7fe-7973-494e-85b1-44aabe3b4a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Flow 'volume_create_manager' (c3dcc2a2-40ff-48be-b48e-9b4bb30ededf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2ec391a9-227c-4186-9b47-a9fbe6fcf536 tempest-SnapshotDependencyTests-2145355828 None] Created volume successfully. Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Deleting offline snapshot e9a9dcc1-a604-4d73-9aa1-5a17ae664981 of volume 9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] snapshot_file for this snap is: volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20dd0f3-6675-45ac-9f19-574a50e88347]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:48 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:48 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:49 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 1073741824" returned: 0 in 0.826s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:49 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 Jul 09 03:07:49 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:49 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043481f-059a-4a29-a2f8-ad337e127307]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:49 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1" returned: 0 in 0.664s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.097s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667025386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd3df7-c991-4c65-a2fc-8f64221ca8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:43Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Creating volume 51cd3df7-c991-4c65-a2fc-8f64221ca8bb {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:49 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fcf81b-d673-4056-9b1d-004a08f77e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fb0ffc-3590-422a-8276-451aef9908f1', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:49 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:49 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:49 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb 1073741824 Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c568e6-ea08-4da0-b453-91c3aef80947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:49 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:49 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Volume volume-76fb0ffc-3590-422a-8276-451aef9908f1 (76fb0ffc-3590-422a-8276-451aef9908f1): created successfully Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c568e6-ea08-4da0-b453-91c3aef80947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:49 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (794dc912-595c-4597-a184-3721bdefb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-869bbceb-6931-4313-8c3c-e22fad2dbe50 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:07:50 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.765s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:50 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:50 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:50 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb 1073741824" returned: 0 in 0.854s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:50 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb Jul 09 03:07:50 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:51 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 0.757s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:51 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981 Jul 09 03:07:51 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:51 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.463s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Creating offline snapshot eaf5adc1-6258-4fd1-8410-83ff95a867ec of volume 76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45d4f1f-94cc-44b4-8ece-6e98c1074fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2874c62-ce48-4b23-bfae-7da87343871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[49595cd8-4682-4c90-8859-df2299f41922]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:51 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Volume volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb (51cd3df7-c991-4c65-a2fc-8f64221ca8bb): created successfully Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2874c62-ce48-4b23-bfae-7da87343871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (1ab4ee39-871b-42f9-a570-fd80cb9c48bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:51 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e9a14e14-aa4c-4739-b12a-0d190a8d39fe tempest-ProjectReaderTests-592133543 None] Created volume successfully. Jul 09 03:07:51 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 Jul 09 03:07:51 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:51 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c.e9a9dcc1-a604-4d73-9aa1-5a17ae664981" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-51cd3df7-c991-4c65-a2fc-8f64221ca8bb-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-e9a9dcc1-a604-4d73-9aa1-5a17ae664981" released by "_delete_snapshot" :: held 3.159s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" released by "delete_snapshot" :: held 3.188s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:51 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "cinder-51cd3df7-c991-4c65-a2fc-8f64221ca8bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-quobyte-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" acquired by "delete_volume" :: waited 0.024s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6fe2b3-ce58-4e4e-87dc-683800196be0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Created reservations ['986ee54a-1c77-4722-b3c4-8c3cfb4a08e2', '7dd88192-f59e-40a6-adbd-82992038f400', '859c54f5-83cc-4dd2-b97f-10c65f37aba4', '324080a5-a637-4d73-b3b9-8fb63ade9f40'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Delete snapshot completed successfully. Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a56f633-8a83-4013-8c22-96b24ba2f0b1 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-e9a9dcc1-a604-4d73-9aa1-5a17ae664981-delete_snapshot" released by "delete_snapshot" :: held 3.407s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:52 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1" returned: 0 in 0.784s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:52 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec 1G Jul 09 03:07:52 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:52 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb Jul 09 03:07:52 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:52 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" returned: 0 in 0.800s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:52 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb Jul 09 03:07:52 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:52 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec 1G" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fb0ffc-3590-422a-8276-451aef9908f1 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:52 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fb0ffc-3590-422a-8276-451aef9908f1 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec Jul 09 03:07:52 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7816aa92-f05d-4f41-ad78-b164a989b9f6]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:53 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:53 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:53 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" returned: 0 in 0.691s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-51cd3df7-c991-4c65-a2fc-8f64221ca8bb" released by "delete_volume" :: held 1.540s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Created reservations ['fd51b915-bf15-4520-8e28-a1b3b6922d6d', 'b7e9116c-1710-49c5-ac6c-2447fbe3c358', '390a8259-a807-4867-873a-bd40d1d7aba6', '46f19d19-642a-4542-854f-8d200c2da20e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:53 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fb0ffc-3590-422a-8276-451aef9908f1 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec" returned: 0 in 0.751s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:53 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec is being set with open permissions: ugo+rw Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:53 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec Jul 09 03:07:53 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:53 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:53 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:53 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.787s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:54 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c Jul 09 03:07:54 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:54 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec" returned: 0 in 0.675s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:54 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info Jul 09 03:07:54 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:54 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.797s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Deleted volume successfully. Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d1a70f01-414a-42ca-9ec8-5d91e94e2e84 tempest-ProjectReaderTests-592133543 None] Lock "cinder-51cd3df7-c991-4c65-a2fc-8f64221ca8bb-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:54 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" returned: 0 in 0.725s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c" released by "delete_volume" :: held 1.587s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (c535074a-1b13-4666-9fa0-b33414f57a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01db96cb-799e-4231-ac4e-cfb899701bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01db96cb-799e-4231-ac4e-cfb899701bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381212821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb12ecd-4a7c-4596-9c75-ff0e204a05ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:55Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be33b4a-f2bf-4876-af18-7cee5f564399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be33b4a-f2bf-4876-af18-7cee5f564399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be09fee0-ddd2-4b11-a6ec-fcd1a336883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be09fee0-ddd2-4b11-a6ec-fcd1a336883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb12ecd-4a7c-4596-9c75-ff0e204a05ba', 'volume_name': 'volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa785ef6-3d34-414f-b9ac-d41da97c3666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa785ef6-3d34-414f-b9ac-d41da97c3666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527c0d20-11ee-4b15-a7ab-1973e01a1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:54 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Volume afb12ecd-4a7c-4596-9c75-ff0e204a05ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba', 'volume_size': 1} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Created reservations ['b93692f7-7d1c-4f7f-b1e0-1ad3a34850eb', '73a8e979-8422-4af7-b148-ac97a44d0b49', '2ce964bc-cb57-4cf6-a4f5-559bdd75d237', '8eca12b2-1428-4d79-83f5-f22fc6c976f8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:54 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:54 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:55 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info" returned: 0 in 0.747s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:55 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info is being set with open permissions: ugo+rw Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:55 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info Jul 09 03:07:55 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-58e284fc-83d1-471b-a638-a4d3ca116cc4-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-58e284fc-83d1-471b-a638-a4d3ca116cc4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecdbce-8e7e-40df-87e1-d30b13516628]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:55 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 Jul 09 03:07:55 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:55 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Deleted volume successfully. Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-06c5577a-ada6-491a-b456-1dbee55e86a7 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-9b7c1b8d-fd2b-450a-813a-4bd5d5a46d1c-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:55 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.info" returned: 0 in 0.635s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381212821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb12ecd-4a7c-4596-9c75-ff0e204a05ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b6a1191e242a1b081e98a85a21819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:07:55Z,use_quota=True,user_id='bfa449b37eea454ca9f6aed3cab41e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Creating volume afb12ecd-4a7c-4596-9c75-ff0e204a05ba {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:07:55 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:07:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:55 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba 1073741824 Jul 09 03:07:55 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:55 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7719dfca-401c-4642-947a-d0a0aca7858b tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-eaf5adc1-6258-4fd1-8410-83ff95a867ec-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-eaf5adc1-6258-4fd1-8410-83ff95a867ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-eaf5adc1-6258-4fd1-8410-83ff95a867ec" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-eaf5adc1-6258-4fd1-8410-83ff95a867ec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot eaf5adc1-6258-4fd1-8410-83ff95a867ec of volume 76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c108eb67-32af-425e-aa21-977b9f73a537]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:56 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4" returned: 0 in 0.813s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:56 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4 Jul 09 03:07:56 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:56 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec Jul 09 03:07:56 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:56 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba 1073741824" returned: 0 in 0.835s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:56 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba Jul 09 03:07:56 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:56 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-58e284fc-83d1-471b-a638-a4d3ca116cc4" returned: 0 in 0.693s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec" returned: 0 in 0.755s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fb0ffc-3590-422a-8276-451aef9908f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-quobyte-58e284fc-83d1-471b-a638-a4d3ca116cc4" released by "delete_volume" :: held 1.562s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb12dd-4c67-4778-9449-c6f891ce5201]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Created reservations ['23673b85-4078-411c-aae6-2f04962debca', '3f31fd40-a6d6-4715-8bb3-757d24d93cfc', '6de2862b-aeb4-4944-ae6c-1d5baa3bfad0', '56650732-9fd5-4789-908d-1b7037aa8762'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:57 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 Jul 09 03:07:57 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:57 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:57 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:57 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" returned: 0 in 0.708s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527c0d20-11ee-4b15-a7ab-1973e01a1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416f2f66-9b5c-4341-955a-3dcf64557545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:07:57 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Volume volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba (afb12ecd-4a7c-4596-9c75-ff0e204a05ba): created successfully Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416f2f66-9b5c-4341-955a-3dcf64557545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Flow 'volume_create_manager' (c535074a-1b13-4666-9fa0-b33414f57a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:07:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-3fb10e91-1b55-4a86-96ab-82b4f8f1417a tempest-ProjectReaderTests-592133543 None] Created volume successfully. Jul 09 03:07:57 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.665s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:07:57 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Deleted volume successfully. Jul 09 03:07:57 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1" returned: 0 in 0.836s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-70ba6a43-af33-4d5c-a219-c045c5f410f8 tempest-SnapshotDependencyTests-2145355828 None] Lock "cinder-58e284fc-83d1-471b-a638-a4d3ca116cc4-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:57 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec Jul 09 03:07:57 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-afb12ecd-4a7c-4596-9c75-ff0e204a05ba-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:57 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "cinder-afb12ecd-4a7c-4596-9c75-ff0e204a05ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Acquiring lock "cinder-quobyte-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a13edd-79d6-440a-84f6-46986a0e0b9a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:58 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba Jul 09 03:07:58 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:58 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec" returned: 0 in 0.843s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:58 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec Jul 09 03:07:58 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:58 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" returned: 0 in 0.806s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:58 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba Jul 09 03:07:58 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:07:59 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1.eaf5adc1-6258-4fd1-8410-83ff95a867ec" returned: 0 in 0.715s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-eaf5adc1-6258-4fd1-8410-83ff95a867ec" released by "_delete_snapshot" :: held 3.281s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" released by "delete_snapshot" :: held 3.305s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Created reservations ['15c2ad6e-0f08-46b9-833f-6faf1e836464', '36a67c58-dc65-4eb7-aab5-b0da71fa21dc', '07cfc5ed-5b1d-473d-a187-0487b02186d7', '48ee35c8-bcc4-4bdb-af11-7cdb0e90548d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:59 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "cinder-quobyte-afb12ecd-4a7c-4596-9c75-ff0e204a05ba" released by "delete_volume" :: held 1.560s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:59 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-b25b68a0-fe32-4d04-a235-d8d4f4c88e16 tempest-ProjectMemberTests-219285624 None] Lock "cinder-eaf5adc1-6258-4fd1-8410-83ff95a867ec-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Created reservations ['2a826bf2-09b8-4fe2-b2bb-c9069ed04672', 'aaff72b0-82ed-4689-9c8c-870d4ebb5330', '66f97edf-ed32-4847-b765-5d940e25b8d1', '0815db84-964d-4aea-8997-32356ef6af70'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:07:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:07:59 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:07:59 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:00 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.704s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-76fb0ffc-3590-422a-8276-451aef9908f1-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:00 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Deleted volume successfully. Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "cinder-76fb0ffc-3590-422a-8276-451aef9908f1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-f999a473-3c34-4130-8a67-588e0190ac9d tempest-ProjectReaderTests-592133543 None] Lock "cinder-afb12ecd-4a7c-4596-9c75-ff0e204a05ba-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1b22a-5057-46f5-91d5-cae8c96e3a7c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:00 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 Jul 09 03:08:00 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:01 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1" returned: 0 in 0.906s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:01 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1 Jul 09 03:08:01 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:02 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-76fb0ffc-3590-422a-8276-451aef9908f1" returned: 0 in 0.808s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-76fb0ffc-3590-422a-8276-451aef9908f1" released by "delete_volume" :: held 1.782s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Created reservations ['28b6bc38-e9f7-4253-8ae1-9eaef288f60d', '644d60fe-b20d-4cad-8e5e-38469bd4cc85', 'e7f95ac9-cfc7-4c99-ac8d-3faa30885cad', '808caab1-2d2e-4468-85fb-a797381496e5'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:02 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:02 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:03 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.665s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9cfb665e-5de7-4d37-9f4c-84e8c266a085 tempest-ProjectMemberTests-219285624 None] Lock "cinder-76fb0ffc-3590-422a-8276-451aef9908f1-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (adf7639e-ba65-48dc-9c05-2ca7d958a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb0a753-020b-45a0-9d59-af88f0435137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb0a753-020b-45a0-9d59-af88f0435137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854416707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c34984-2626-46b6-8ee4-1c306c044b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:03Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2116eca4-6c5c-401a-ae13-0c186bca17b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2116eca4-6c5c-401a-ae13-0c186bca17b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f175d-c2a4-40e7-ac8c-89f65b8cf4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f175d-c2a4-40e7-ac8c-89f65b8cf4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c34984-2626-46b6-8ee4-1c306c044b04', 'volume_name': 'volume-f2c34984-2626-46b6-8ee4-1c306c044b04', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fe9934-31ac-44b9-a716-d8f18c5ba4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fe9934-31ac-44b9-a716-d8f18c5ba4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2c0660-f6e2-4e74-bb02-24b69146feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:03 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Volume f2c34984-2626-46b6-8ee4-1c306c044b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c34984-2626-46b6-8ee4-1c306c044b04', 'volume_size': 1} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1854416707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c34984-2626-46b6-8ee4-1c306c044b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:03Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Creating volume f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:03 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:08:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:03 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 1073741824 Jul 09 03:08:03 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:04 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 1073741824" returned: 0 in 0.832s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:04 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 Jul 09 03:08:04 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:04 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04" returned: 0 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2c0660-f6e2-4e74-bb02-24b69146feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c34984-2626-46b6-8ee4-1c306c044b04', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d4946e-e7d8-4023-925c-6fdda792b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:04 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Volume volume-f2c34984-2626-46b6-8ee4-1c306c044b04 (f2c34984-2626-46b6-8ee4-1c306c044b04): created successfully Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d4946e-e7d8-4023-925c-6fdda792b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:04 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (adf7639e-ba65-48dc-9c05-2ca7d958a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:04 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-49dfbee2-0125-4468-aa99-b1dd59fb2c5a tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:08:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:05 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 7068e5dc-659f-4eea-8988-f7c2a41ab752 of volume f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:05 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ae2ad-95da-4ff9-ab05-2ad65bdc86d2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:05 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 Jul 09 03:08:05 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:06 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04" returned: 0 in 0.860s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:06 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 1G Jul 09 03:08:06 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:07 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 1G" returned: 0 in 0.868s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c34984-2626-46b6-8ee4-1c306c044b04 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:07 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c34984-2626-46b6-8ee4-1c306c044b04 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 Jul 09 03:08:07 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:07 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c34984-2626-46b6-8ee4-1c306c044b04 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:07 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 is being set with open permissions: ugo+rw Jul 09 03:08:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:07 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 Jul 09 03:08:07 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:08 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752" returned: 0 in 0.721s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:08 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info Jul 09 03:08:08 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:09 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info" returned: 0 in 0.627s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:09 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info is being set with open permissions: ugo+rw Jul 09 03:08:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:09 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info Jul 09 03:08:09 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:10 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.info" returned: 0 in 0.699s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.574s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-472734a6-e628-4968-a8f5-7a7dd45b5e45 tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-7068e5dc-659f-4eea-8988-f7c2a41ab752-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-7068e5dc-659f-4eea-8988-f7c2a41ab752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-7068e5dc-659f-4eea-8988-f7c2a41ab752" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-7068e5dc-659f-4eea-8988-f7c2a41ab752" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 7068e5dc-659f-4eea-8988-f7c2a41ab752 of volume f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfb5bea-b5d4-49b4-9d7b-33ca2d78f097]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:10 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 Jul 09 03:08:10 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:11 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2c34984-2626-46b6-8ee4-1c306c044b04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[690192ff-3535-44d3-8270-900049d417a3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:11 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 Jul 09 03:08:11 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:12 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:12 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 Jul 09 03:08:12 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:12 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752" returned: 0 in 0.695s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:12 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752 Jul 09 03:08:12 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:13 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04.7068e5dc-659f-4eea-8988-f7c2a41ab752" returned: 0 in 0.604s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-7068e5dc-659f-4eea-8988-f7c2a41ab752" released by "_delete_snapshot" :: held 2.836s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" released by "delete_snapshot" :: held 2.855s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Created reservations ['18727244-4701-4229-bd18-43ed80da174e', '052dcdbb-74f4-4797-84f5-f84af56bc260', '06c08fa2-a15c-49ec-acd3-50d8131247e7', 'e1785229-550d-4491-9097-e78c04331a76'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:13 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-699e19f0-3cff-4601-8f42-89f4b6dcbe72 tempest-ProjectMemberTests-219285624 None] Lock "cinder-7068e5dc-659f-4eea-8988-f7c2a41ab752-delete_snapshot" released by "delete_snapshot" :: held 2.983s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-f2c34984-2626-46b6-8ee4-1c306c044b04-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "cinder-f2c34984-2626-46b6-8ee4-1c306c044b04-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe64ef-e165-4d37-8419-0f6625865956]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:14 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 Jul 09 03:08:14 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:14 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04" returned: 0 in 0.719s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:14 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04 Jul 09 03:08:14 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:15 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-f2c34984-2626-46b6-8ee4-1c306c044b04" returned: 0 in 0.610s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-f2c34984-2626-46b6-8ee4-1c306c044b04" released by "delete_volume" :: held 1.386s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Created reservations ['11a9f5e6-f6db-47d1-8952-a539949c2848', '46a34584-e9d2-43da-a590-75471fa8e10d', '6fd5c958-a3a4-4f11-b59f-1ae3881ad4e9', 'a19fb142-7e47-49db-8480-fee328cb5f7c'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:15 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:15 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:16 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-96618568-275a-4775-9547-0f08556fa70d tempest-ProjectMemberTests-219285624 None] Lock "cinder-f2c34984-2626-46b6-8ee4-1c306c044b04-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (b46f14ed-dc86-40cc-b04f-ef336a534b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d19306-47b0-4be7-957a-3b91900b4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d19306-47b0-4be7-957a-3b91900b4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856399787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805f505b-42d3-4163-8fc9-db6aff24486d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:16Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d6e0af-d27e-4f82-b2ca-71f2bde19991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d6e0af-d27e-4f82-b2ca-71f2bde19991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1173aa-5fa2-4e82-b614-e454979a744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1173aa-5fa2-4e82-b614-e454979a744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805f505b-42d3-4163-8fc9-db6aff24486d', 'volume_name': 'volume-805f505b-42d3-4163-8fc9-db6aff24486d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca3046d-863c-4d47-86e6-8dcf209f2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca3046d-863c-4d47-86e6-8dcf209f2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b2bdd-a19b-46d4-9a6f-40f1f39e4f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:16 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Volume 805f505b-42d3-4163-8fc9-db6aff24486d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805f505b-42d3-4163-8fc9-db6aff24486d', 'volume_size': 1} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856399787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805f505b-42d3-4163-8fc9-db6aff24486d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:16Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Creating volume 805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:16 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:08:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:16 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d 1073741824 Jul 09 03:08:16 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:17 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d 1073741824" returned: 0 in 0.783s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:17 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d Jul 09 03:08:17 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:18 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d" returned: 0 in 0.610s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b2bdd-a19b-46d4-9a6f-40f1f39e4f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805f505b-42d3-4163-8fc9-db6aff24486d', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44366684-febc-41c5-a2a2-a78d1bcc004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:18 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Volume volume-805f505b-42d3-4163-8fc9-db6aff24486d (805f505b-42d3-4163-8fc9-db6aff24486d): created successfully Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44366684-febc-41c5-a2a2-a78d1bcc004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (b46f14ed-dc86-40cc-b04f-ef336a534b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:18 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2fa78e3b-8f22-4515-87d8-f3c634a40009 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Creating offline snapshot c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 of volume 805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f886ac-ada5-4b26-b48e-668da57bef97]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:18 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d Jul 09 03:08:18 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:19 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d" returned: 0 in 0.714s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:19 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 1G Jul 09 03:08:19 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:20 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 1G" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805f505b-42d3-4163-8fc9-db6aff24486d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:20 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805f505b-42d3-4163-8fc9-db6aff24486d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 Jul 09 03:08:20 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:20 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805f505b-42d3-4163-8fc9-db6aff24486d -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" returned: 0 in 0.655s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:20 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 is being set with open permissions: ugo+rw Jul 09 03:08:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:20 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 Jul 09 03:08:20 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:21 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" returned: 0 in 0.613s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:21 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info Jul 09 03:08:21 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:22 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info" returned: 0 in 0.611s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:22 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info is being set with open permissions: ugo+rw Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:22 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info Jul 09 03:08:22 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:22 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.info" returned: 0 in 0.595s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.025s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:22 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8e39040e-9c14-4112-980a-d0a32111cb93 tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 of volume 805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4f83c-5a61-4b3d-94cc-8f00f3f77515]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:23 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 Jul 09 03:08:23 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:23 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" returned: 0 in 0.715s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805f505b-42d3-4163-8fc9-db6aff24486d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:23 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3b6048-1ea8-438f-a085-e8119b9c1184]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:23 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d Jul 09 03:08:23 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:24 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d" returned: 0 in 0.740s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:24 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 Jul 09 03:08:24 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:25 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" returned: 0 in 0.700s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:25 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981 Jul 09 03:08:25 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:25 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d.c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" returned: 0 in 0.615s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981" released by "_delete_snapshot" :: held 2.857s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" released by "delete_snapshot" :: held 2.876s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Created reservations ['f83164cb-45e6-432d-b33c-27e36a940aba', 'e18adce5-4de5-4b74-adbc-b5b5ef31f64f', 'ebac291a-1eda-447d-ab5b-18b028c65567', '3c7e4ce0-8e05-4775-8d30-7444f4b639cb'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:08:25 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-d88b3394-4ca7-43cf-bd1b-d298862d28f4 tempest-ProjectMemberTests-219285624 None] Lock "cinder-c9a88b9a-b29b-44d1-94a2-aad1d3dc0981-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-805f505b-42d3-4163-8fc9-db6aff24486d-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "cinder-805f505b-42d3-4163-8fc9-db6aff24486d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2cf942-0b2e-4789-827d-64a2a1ace69d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:26 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d Jul 09 03:08:26 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:26 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:26 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d Jul 09 03:08:26 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:27 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-805f505b-42d3-4163-8fc9-db6aff24486d" returned: 0 in 0.618s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-805f505b-42d3-4163-8fc9-db6aff24486d" released by "delete_volume" :: held 1.394s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Created reservations ['3381092b-8315-4d33-a7d4-ef4fa194f76d', '69eb33ff-c9a9-4bb9-a8e9-c98be57a5db2', '0628c57c-4c8a-4042-8686-f24abf0d3b25', '6a35a5ad-168a-411f-b487-1a6dd35de4ef'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:27 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:27 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:27 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:27 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:28 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.653s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:28 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8c1f01b4-ef8e-4d26-948b-6b6510fea218 tempest-ProjectMemberTests-219285624 None] Lock "cinder-805f505b-42d3-4163-8fc9-db6aff24486d-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:28 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.687s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (9ef8626f-996f-4abf-ba20-953d7d7d02d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ad235d-2aa6-4077-a9c3-cb5f18caf58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ad235d-2aa6-4077-a9c3-cb5f18caf58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369781141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e879efc-4793-4c3c-9f0a-758a6268919e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:29Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cc758a-a7f6-4494-ad6b-2e4a138e5e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20cc758a-a7f6-4494-ad6b-2e4a138e5e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab347c6c-71a9-4a26-9fe9-16a28e8c39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab347c6c-71a9-4a26-9fe9-16a28e8c39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e879efc-4793-4c3c-9f0a-758a6268919e', 'volume_name': 'volume-4e879efc-4793-4c3c-9f0a-758a6268919e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1978b810-33ad-4a39-9401-c9d20cedc1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1978b810-33ad-4a39-9401-c9d20cedc1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cfea47-b5c4-4185-b92c-d83bfd6c9832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:28 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Volume 4e879efc-4793-4c3c-9f0a-758a6268919e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e879efc-4793-4c3c-9f0a-758a6268919e', 'volume_size': 1} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369781141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e879efc-4793-4c3c-9f0a-758a6268919e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:29Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Creating volume 4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:28 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:08:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:28 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e 1073741824 Jul 09 03:08:28 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:29 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e 1073741824" returned: 0 in 0.775s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:29 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e Jul 09 03:08:29 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:30 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e" returned: 0 in 0.628s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cfea47-b5c4-4185-b92c-d83bfd6c9832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e879efc-4793-4c3c-9f0a-758a6268919e', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5b627-037f-46b3-bfdc-a9ecfbdcb4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:30 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Volume volume-4e879efc-4793-4c3c-9f0a-758a6268919e (4e879efc-4793-4c3c-9f0a-758a6268919e): created successfully Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5b627-037f-46b3-bfdc-a9ecfbdcb4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:30 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (9ef8626f-996f-4abf-ba20-953d7d7d02d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2dce92ac-7e6a-4935-8168-867b29f0ea19 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 95175934-a14c-4d3d-925e-81b847ca42a3 of volume 4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e70c6-1d5f-4d96-8e7b-c323cfbffc9a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:31 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e Jul 09 03:08:31 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:31 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e" returned: 0 in 0.736s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:31 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 1G Jul 09 03:08:31 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:32 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 1G" returned: 0 in 0.772s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e879efc-4793-4c3c-9f0a-758a6268919e -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:32 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e879efc-4793-4c3c-9f0a-758a6268919e -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 Jul 09 03:08:32 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:33 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e879efc-4793-4c3c-9f0a-758a6268919e -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3" returned: 0 in 0.660s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:33 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 is being set with open permissions: ugo+rw Jul 09 03:08:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:33 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 Jul 09 03:08:33 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:33 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3" returned: 0 in 0.603s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:33 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info Jul 09 03:08:33 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:34 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info" returned: 0 in 0.603s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:34 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info is being set with open permissions: ugo+rw Jul 09 03:08:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:34 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info Jul 09 03:08:34 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:35 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.info" returned: 0 in 0.603s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.071s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-16b5f0fe-ca3c-4443-a4fa-92609d956ba2 tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-95175934-a14c-4d3d-925e-81b847ca42a3-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-95175934-a14c-4d3d-925e-81b847ca42a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-95175934-a14c-4d3d-925e-81b847ca42a3" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-95175934-a14c-4d3d-925e-81b847ca42a3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 95175934-a14c-4d3d-925e-81b847ca42a3 of volume 4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f946f1f-706a-4b1a-838c-0088dda09cc9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:36 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 Jul 09 03:08:36 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:37 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3" returned: 0 in 0.714s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e879efc-4793-4c3c-9f0a-758a6268919e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[911dda5a-ff8b-4313-bb93-87fdafdb628c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:37 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e Jul 09 03:08:37 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:37 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e" returned: 0 in 0.727s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:37 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 Jul 09 03:08:37 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:38 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3" returned: 0 in 0.706s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:38 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3 Jul 09 03:08:38 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:39 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e.95175934-a14c-4d3d-925e-81b847ca42a3" returned: 0 in 0.634s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-95175934-a14c-4d3d-925e-81b847ca42a3" released by "_delete_snapshot" :: held 2.875s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" released by "delete_snapshot" :: held 2.895s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Created reservations ['ed99f331-1996-4244-8450-3636c736084f', '6ed2c44a-4039-4b49-a147-b9e2f9267e67', 'ca3834d7-e776-4c87-a6ef-eec8723f61b5', '0804bbe5-7f73-496f-8af4-e4f3a9ad59d8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:39 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-499fa936-32d6-4d42-812e-494ec745dc50 tempest-ProjectMemberTests-219285624 None] Lock "cinder-95175934-a14c-4d3d-925e-81b847ca42a3-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-4e879efc-4793-4c3c-9f0a-758a6268919e-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "cinder-4e879efc-4793-4c3c-9f0a-758a6268919e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3a624-132e-43b1-9c8f-d60bb437f144]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:39 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e Jul 09 03:08:39 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:40 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e" returned: 0 in 0.735s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:40 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e Jul 09 03:08:40 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:40 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-4e879efc-4793-4c3c-9f0a-758a6268919e" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-4e879efc-4793-4c3c-9f0a-758a6268919e" released by "delete_volume" :: held 1.426s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Created reservations ['fdb85fd0-4dc9-4782-b034-61fbe6375fe9', 'e6cbcf85-ee4d-477f-abb4-8fff4cbb2642', 'e782f81a-030b-4eea-913a-1a7e14f1f0c1', '84873abb-cf15-4be1-b031-637b85412dd8'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:41 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:41 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:41 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.647s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:41 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:41 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:08:41 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9d965b79-6cd6-49fe-87b6-e5cf281bc951 tempest-ProjectMemberTests-219285624 None] Lock "cinder-4e879efc-4793-4c3c-9f0a-758a6268919e-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (d28739d0-d621-4e42-9aa9-bb3c70568249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc19c7d-efcf-400b-84cf-2131463bffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc19c7d-efcf-400b-84cf-2131463bffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880176357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027748df-a27a-44bc-ab18-72c168943813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:42Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013a44c4-fc34-41d9-9ea0-c670e91662ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013a44c4-fc34-41d9-9ea0-c670e91662ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9066a41-ed25-40ad-90c1-cc27b03f7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9066a41-ed25-40ad-90c1-cc27b03f7062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027748df-a27a-44bc-ab18-72c168943813', 'volume_name': 'volume-027748df-a27a-44bc-ab18-72c168943813', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0b9d86-f76d-48e1-a9fe-9d5e95afe9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0b9d86-f76d-48e1-a9fe-9d5e95afe9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423d9989-526d-47f2-9f9d-7e6010529f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:42 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Volume 027748df-a27a-44bc-ab18-72c168943813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027748df-a27a-44bc-ab18-72c168943813', 'volume_size': 1} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880176357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027748df-a27a-44bc-ab18-72c168943813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:42Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Creating volume 027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:42 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:42 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 1073741824 Jul 09 03:08:42 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:42 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 1073741824" returned: 0 in 0.794s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:42 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 Jul 09 03:08:42 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:43 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813" returned: 0 in 0.640s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423d9989-526d-47f2-9f9d-7e6010529f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027748df-a27a-44bc-ab18-72c168943813', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42f1807-f4b5-4877-bcdc-93b2494f52f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Volume volume-027748df-a27a-44bc-ab18-72c168943813 (027748df-a27a-44bc-ab18-72c168943813): created successfully Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42f1807-f4b5-4877-bcdc-93b2494f52f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (d28739d0-d621-4e42-9aa9-bb3c70568249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5c262221-53df-45b5-beb4-93776d71c8d8 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:08:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 032a3650-c322-4e1c-a941-849de6e0608f of volume 027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:44 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f9d63a-5944-47c3-b88f-891b8690470c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:44 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 Jul 09 03:08:44 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:45 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:45 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f 1G Jul 09 03:08:45 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:45 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f 1G" returned: 0 in 0.766s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027748df-a27a-44bc-ab18-72c168943813 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:45 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027748df-a27a-44bc-ab18-72c168943813 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f Jul 09 03:08:45 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:46 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027748df-a27a-44bc-ab18-72c168943813 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f" returned: 0 in 0.674s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:46 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f is being set with open permissions: ugo+rw Jul 09 03:08:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:46 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f Jul 09 03:08:46 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:47 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f" returned: 0 in 0.609s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=122,cinder:SELECT=93,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=84,cinder:UPDATE=118,cinder:DELETE=12,cinder:INSERT=32 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:47 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info Jul 09 03:08:47 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:47 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info" returned: 0 in 0.639s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:47 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info is being set with open permissions: ugo+rw Jul 09 03:08:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:47 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info Jul 09 03:08:47 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:48 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.info" returned: 0 in 0.605s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.099s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9e56e1a6-b4e9-467f-a464-67ae28ff47de tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-032a3650-c322-4e1c-a941-849de6e0608f-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-032a3650-c322-4e1c-a941-849de6e0608f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-032a3650-c322-4e1c-a941-849de6e0608f" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-032a3650-c322-4e1c-a941-849de6e0608f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 032a3650-c322-4e1c-a941-849de6e0608f of volume 027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e042505b-bc1c-4b68-ad0c-f1279c893c46]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:49 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f Jul 09 03:08:49 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:50 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f" returned: 0 in 0.726s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-027748df-a27a-44bc-ab18-72c168943813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa1d9b7-67be-411c-bbb5-2997694a26d2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:50 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 Jul 09 03:08:50 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:50 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813" returned: 0 in 0.706s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:51 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f Jul 09 03:08:51 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:51 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:51 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f Jul 09 03:08:51 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:52 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813.032a3650-c322-4e1c-a941-849de6e0608f" returned: 0 in 0.627s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-032a3650-c322-4e1c-a941-849de6e0608f" released by "_delete_snapshot" :: held 2.839s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" released by "delete_snapshot" :: held 2.860s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Created reservations ['eb8220cc-31d9-468c-99a5-03879c352360', '93c1f1da-6d92-41bd-a6de-cba17e9e2f3e', 'c03f9710-3955-45b8-830c-72079f4e6757', 'aade0892-20e4-4596-8309-3a81c058059d'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-94c96e42-e95d-4e89-a1eb-cf74350775cb tempest-ProjectMemberTests-219285624 None] Lock "cinder-032a3650-c322-4e1c-a941-849de6e0608f-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-027748df-a27a-44bc-ab18-72c168943813-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "cinder-027748df-a27a-44bc-ab18-72c168943813-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" acquired by "delete_volume" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb1f7e-aaf5-4275-91d5-174283f06021]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:52 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 Jul 09 03:08:52 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:53 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813" returned: 0 in 0.718s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:53 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813 Jul 09 03:08:53 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-027748df-a27a-44bc-ab18-72c168943813" returned: 0 in 0.628s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-027748df-a27a-44bc-ab18-72c168943813" released by "delete_volume" :: held 1.399s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Created reservations ['e39225ac-0439-4b49-b2c2-b30791bf5dc4', '98f4d7fd-209b-4419-a7ca-cb10277b9486', 'c164486a-6529-4e43-ac5d-0d05c5a534ea', '1ab49ab3-e9e0-45c7-975d-794f82144929'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:54 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:08:54 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:54 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.633s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:08:54 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:08:54 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-498cdea6-a06b-4162-b3fb-694425f39e68 tempest-ProjectMemberTests-219285624 None] Lock "cinder-027748df-a27a-44bc-ab18-72c168943813-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (2869312a-a56a-48e4-ae24-ce4c33c08a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8d41cf-3152-4109-b908-06900bf75321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8d41cf-3152-4109-b908-06900bf75321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317829773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621acfca-9355-4089-88d7-4ddf2ffd0b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:55Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c414eb5-fef2-4da3-b8fe-223216ba0a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c414eb5-fef2-4da3-b8fe-223216ba0a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb5cce-1195-4c8f-a60d-3ceeaa8d11ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb5cce-1195-4c8f-a60d-3ceeaa8d11ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621acfca-9355-4089-88d7-4ddf2ffd0b37', 'volume_name': 'volume-621acfca-9355-4089-88d7-4ddf2ffd0b37', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ce5a8c-6d69-4f61-8201-7d3a7493a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ce5a8c-6d69-4f61-8201-7d3a7493a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887b7dfc-dd5b-40af-a00e-2dea2b38c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:55 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Volume 621acfca-9355-4089-88d7-4ddf2ffd0b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621acfca-9355-4089-88d7-4ddf2ffd0b37', 'volume_size': 1} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317829773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621acfca-9355-4089-88d7-4ddf2ffd0b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:08:55Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Creating volume 621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:08:55 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:08:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:55 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 1073741824 Jul 09 03:08:55 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:56 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 1073741824" returned: 0 in 0.775s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:56 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 Jul 09 03:08:56 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:56 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37" returned: 0 in 0.646s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887b7dfc-dd5b-40af-a00e-2dea2b38c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621acfca-9355-4089-88d7-4ddf2ffd0b37', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c00910-6fb2-4ec8-9c91-d75edbfeea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:08:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Volume volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 (621acfca-9355-4089-88d7-4ddf2ffd0b37): created successfully Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c00910-6fb2-4ec8-9c91-d75edbfeea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:08:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (2869312a-a56a-48e4-ae24-ce4c33c08a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:08:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ad06d25a-bb51-4abd-a960-7e04662ccb3e tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:08:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:08:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:08:57 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 423dd058-6d9f-4c95-89ae-adce76e0cb9c of volume 621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:08:57 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[99784ecb-feb7-4aa7-a91d-0ae567b0e647]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:08:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:57 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 Jul 09 03:08:57 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:58 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:58 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c 1G Jul 09 03:08:58 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:59 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c 1G" returned: 0 in 0.839s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:59 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c Jul 09 03:08:59 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:08:59 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 09 03:08:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c" returned: 0 in 0.707s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:08:59 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c is being set with open permissions: ugo+rw Jul 09 03:08:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:08:59 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c Jul 09 03:08:59 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:00 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c" returned: 0 in 0.719s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:00 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info Jul 09 03:09:00 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:01 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info" returned: 0 in 0.642s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:01 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info is being set with open permissions: ugo+rw Jul 09 03:09:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:01 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info Jul 09 03:09:01 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:01 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.info" returned: 0 in 0.631s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.346s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:01 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d0acf3bf-677d-4774-a93e-3e1871f913bf tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-423dd058-6d9f-4c95-89ae-adce76e0cb9c-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-423dd058-6d9f-4c95-89ae-adce76e0cb9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-423dd058-6d9f-4c95-89ae-adce76e0cb9c" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-423dd058-6d9f-4c95-89ae-adce76e0cb9c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 423dd058-6d9f-4c95-89ae-adce76e0cb9c of volume 621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[685079b7-e9b5-4dbf-9426-90936b9e3051]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:02 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c Jul 09 03:09:02 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:03 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c" returned: 0 in 0.785s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621acfca-9355-4089-88d7-4ddf2ffd0b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:03 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8877dd74-0ff2-4089-b9d6-aa2cdce826a8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:03 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 Jul 09 03:09:03 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:04 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37" returned: 0 in 0.762s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:04 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c Jul 09 03:09:04 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:05 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:05 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c Jul 09 03:09:05 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:05 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37.423dd058-6d9f-4c95-89ae-adce76e0cb9c" returned: 0 in 0.637s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-423dd058-6d9f-4c95-89ae-adce76e0cb9c" released by "_delete_snapshot" :: held 3.020s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" released by "delete_snapshot" :: held 3.043s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Created reservations ['444c0de7-831e-4cff-9939-dbb1eee1fcb1', 'af68c145-60db-4d35-8a60-921359cf969c', '65540909-0e49-47b7-b2cd-7e0857c83ed7', '7e54001c-07db-48a9-b7d0-365a94cccabc'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:05 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:09:05 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-6d28d5b0-f66d-4db3-8712-a109cf0946fd tempest-ProjectMemberTests-219285624 None] Lock "cinder-423dd058-6d9f-4c95-89ae-adce76e0cb9c-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-621acfca-9355-4089-88d7-4ddf2ffd0b37-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:06 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "cinder-621acfca-9355-4089-88d7-4ddf2ffd0b37-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e619a-b572-49bd-bc45-9f7484efdda0]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:07 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 Jul 09 03:09:07 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:07 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:07 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37 Jul 09 03:09:07 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:08 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-621acfca-9355-4089-88d7-4ddf2ffd0b37" returned: 0 in 0.663s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-621acfca-9355-4089-88d7-4ddf2ffd0b37" released by "delete_volume" :: held 1.463s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Created reservations ['c6d696d8-61f7-44f9-97ba-6c15a80385de', '17a0bb61-71c7-4aba-a91f-8a154d66dad6', 'd78a6ae1-cf0e-4a81-8b39-0f258f4e6de5', 'd364060c-63fc-4165-8446-afb5414333b7'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:08 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:09:08 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:09 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.691s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:09 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8126943a-0958-4ea6-be46-00ea93d452d1 tempest-ProjectMemberTests-219285624 None] Lock "cinder-621acfca-9355-4089-88d7-4ddf2ffd0b37-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (1effbc51-6d9d-4570-a0de-ca808e5e3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb8bc4b-01ff-405b-b585-720b90fe95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb8bc4b-01ff-405b-b585-720b90fe95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725458323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11bf34b-269d-4793-befc-2f83e49f8a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:10Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cf07e-ff88-4fcf-9ae3-7854a85b86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cf07e-ff88-4fcf-9ae3-7854a85b86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2629f4bd-1b7f-4398-9146-9be016c763fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2629f4bd-1b7f-4398-9146-9be016c763fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11bf34b-269d-4793-befc-2f83e49f8a84', 'volume_name': 'volume-e11bf34b-269d-4793-befc-2f83e49f8a84', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ebaae-0c66-4ae7-b9c2-4d04795c2654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ebaae-0c66-4ae7-b9c2-4d04795c2654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9328ce33-7d33-4a38-b7f0-57fd6be5da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:09 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Volume e11bf34b-269d-4793-befc-2f83e49f8a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11bf34b-269d-4793-befc-2f83e49f8a84', 'volume_size': 1} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725458323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11bf34b-269d-4793-befc-2f83e49f8a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:10Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Creating volume e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:09 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:09:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:09 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 1073741824 Jul 09 03:09:09 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:10 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 1073741824" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:10 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 Jul 09 03:09:10 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:11 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84" returned: 0 in 0.648s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9328ce33-7d33-4a38-b7f0-57fd6be5da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11bf34b-269d-4793-befc-2f83e49f8a84', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8878c3-576f-4000-aa54-7426ab2d8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Volume volume-e11bf34b-269d-4793-befc-2f83e49f8a84 (e11bf34b-269d-4793-befc-2f83e49f8a84): created successfully Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8878c3-576f-4000-aa54-7426ab2d8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (1effbc51-6d9d-4570-a0de-ca808e5e3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:11 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-6bb38795-16e3-4e74-a837-6bc0e4067d1a tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 5510f960-27d9-4f21-a1ce-886602a33ad5 of volume e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a71c1bb-6cb2-4d7b-9800-25957ffe4473]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:12 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 Jul 09 03:09:12 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:12 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84" returned: 0 in 0.771s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:12 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 1G Jul 09 03:09:12 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:13 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 1G" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11bf34b-269d-4793-befc-2f83e49f8a84 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:13 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11bf34b-269d-4793-befc-2f83e49f8a84 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 Jul 09 03:09:13 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:14 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11bf34b-269d-4793-befc-2f83e49f8a84 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5" returned: 0 in 0.722s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:14 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 is being set with open permissions: ugo+rw Jul 09 03:09:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:14 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 Jul 09 03:09:14 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:14 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5" returned: 0 in 0.629s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:14 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info Jul 09 03:09:14 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:15 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info" returned: 0 in 0.636s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:15 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info is being set with open permissions: ugo+rw Jul 09 03:09:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:15 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info Jul 09 03:09:15 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:16 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.info" returned: 0 in 0.647s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.257s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:16 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2ee94dce-dc4b-42c0-9c2a-ed74c6f24e0d tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-5510f960-27d9-4f21-a1ce-886602a33ad5-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-5510f960-27d9-4f21-a1ce-886602a33ad5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-5510f960-27d9-4f21-a1ce-886602a33ad5" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-5510f960-27d9-4f21-a1ce-886602a33ad5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 5510f960-27d9-4f21-a1ce-886602a33ad5 of volume e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[461eb5d6-9daa-460c-8651-06f091a76b9c]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:17 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 Jul 09 03:09:17 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:17 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5" returned: 0 in 0.747s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:17 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11bf34b-269d-4793-befc-2f83e49f8a84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[db032097-ad59-4d69-96be-7cff1cb0bccb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:18 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 Jul 09 03:09:18 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:18 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84" returned: 0 in 0.776s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:18 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 Jul 09 03:09:18 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:19 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:19 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5 Jul 09 03:09:19 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:20 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84.5510f960-27d9-4f21-a1ce-886602a33ad5" returned: 0 in 0.662s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-5510f960-27d9-4f21-a1ce-886602a33ad5" released by "_delete_snapshot" :: held 2.996s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" released by "delete_snapshot" :: held 3.021s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:20 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Created reservations ['ff61ae35-ca91-48da-8a9d-88fb53666540', 'fd0d0911-482e-4868-8682-dc29976c4c4d', '0c9c30a0-5f86-4dd7-a952-798a95b4f3f4', 'b82bf5fb-976d-4f5d-b5b1-1c9ce19b647e'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:20 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:09:20 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-5c32a5c5-16c6-443a-abde-e082820a16db tempest-ProjectMemberTests-219285624 None] Lock "cinder-5510f960-27d9-4f21-a1ce-886602a33ad5-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-e11bf34b-269d-4793-befc-2f83e49f8a84-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "cinder-e11bf34b-269d-4793-befc-2f83e49f8a84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b07c1-5e35-407d-b44f-4712677df349]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:21 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 Jul 09 03:09:21 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:22 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84" returned: 0 in 0.821s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:22 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84 Jul 09 03:09:22 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:22 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-e11bf34b-269d-4793-befc-2f83e49f8a84" returned: 0 in 0.643s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:22 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-e11bf34b-269d-4793-befc-2f83e49f8a84" released by "delete_volume" :: held 1.518s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:22 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Created reservations ['c395e718-6c98-48da-9486-b11c3de5c032', '70886551-e3bd-4e34-b0fa-b11d6806e0c2', 'dc7ae3f3-7bcd-4414-8439-a28cf7ea1835', 'ff40d760-f484-4113-9a99-1acea4e66ab6'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:23 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:09:23 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:23 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.670s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:09:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-9a454550-8bfc-4fbd-8003-5173ceade6db tempest-ProjectMemberTests-219285624 None] Lock "cinder-e11bf34b-269d-4793-befc-2f83e49f8a84-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (f4f6f298-bd3e-46bb-a61f-9a04b5894371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d32c623-9f05-4ffb-88c1-4a9691bfe876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d32c623-9f05-4ffb-88c1-4a9691bfe876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823298532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519614fc-d935-411d-8a6f-8e45d0f9e9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:24Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e9986-9115-40b0-be5e-5afb2cac0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e9986-9115-40b0-be5e-5afb2cac0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ed4c50-a9bd-4c43-996a-a3001da32ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ed4c50-a9bd-4c43-996a-a3001da32ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519614fc-d935-411d-8a6f-8e45d0f9e9ab', 'volume_name': 'volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253fdd97-dd74-4bfd-8c7e-c26d70928af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253fdd97-dd74-4bfd-8c7e-c26d70928af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b92eea-9a2f-4649-8683-9ae8909923f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Volume 519614fc-d935-411d-8a6f-8e45d0f9e9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab', 'volume_size': 1} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823298532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519614fc-d935-411d-8a6f-8e45d0f9e9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfb40edf30242cda3040dbcc3265b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:24Z,use_quota=True,user_id='7b53c461ff944a10a44454edc048b291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Creating volume 519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:24 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:24 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab 1073741824 Jul 09 03:09:24 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:24 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab 1073741824" returned: 0 in 0.817s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:25 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab Jul 09 03:09:25 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:25 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab" returned: 0 in 0.724s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b92eea-9a2f-4649-8683-9ae8909923f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2ef732-b97b-4c37-b036-d0768895e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:25 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Volume volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab (519614fc-d935-411d-8a6f-8e45d0f9e9ab): created successfully Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2ef732-b97b-4c37-b036-d0768895e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:25 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Flow 'volume_create_manager' (f4f6f298-bd3e-46bb-a61f-9a04b5894371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:25 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-53f3dba5-68bd-4af7-94bd-ce957a8fb389 tempest-ProjectMemberTests-219285624 None] Created volume successfully. Jul 09 03:09:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Creating offline snapshot 985da92c-2ebb-4e01-9273-5132705022a0 of volume 519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[84079e1d-30ff-4ae7-86f9-17c062ae7735]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:26 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab Jul 09 03:09:26 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:27 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab" returned: 0 in 0.739s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:27 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 1G Jul 09 03:09:27 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:27 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 1G" returned: 0 in 0.819s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:27 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 Jul 09 03:09:27 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:27 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:09:27 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:28 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0" returned: 0 in 0.727s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:28 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 is being set with open permissions: ugo+rw Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:28 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 Jul 09 03:09:28 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:28 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.681s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:09:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:09:29 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0" returned: 0 in 0.664s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:29 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info Jul 09 03:09:29 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:29 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info" returned: 0 in 0.663s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:29 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info is being set with open permissions: ugo+rw Jul 09 03:09:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:29 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info Jul 09 03:09:29 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:30 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.info" returned: 0 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.397s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-548671fb-92d3-443f-bdb3-e7b9bdecbead tempest-ProjectMemberTests-219285624 None] Create snapshot completed successfully Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-985da92c-2ebb-4e01-9273-5132705022a0-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-985da92c-2ebb-4e01-9273-5132705022a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-985da92c-2ebb-4e01-9273-5132705022a0" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-985da92c-2ebb-4e01-9273-5132705022a0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Deleting offline snapshot 985da92c-2ebb-4e01-9273-5132705022a0 of volume 519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] snapshot_file for this snap is: volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[9facc945-62d6-436c-973b-a51e96c07cd4]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:31 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 Jul 09 03:09:31 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:32 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0" returned: 0 in 0.864s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d6e682-abf5-49b3-9c3e-39ff786d5092]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:32 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab Jul 09 03:09:32 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:33 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab" returned: 0 in 0.779s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:33 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 Jul 09 03:09:33 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:34 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0" returned: 0 in 0.773s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:34 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0 Jul 09 03:09:34 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:34 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab.985da92c-2ebb-4e01-9273-5132705022a0" returned: 0 in 0.711s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-985da92c-2ebb-4e01-9273-5132705022a0" released by "_delete_snapshot" :: held 3.223s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" released by "delete_snapshot" :: held 3.247s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:34 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Created reservations ['553769bb-fb6d-4010-8653-71abed8e9ec1', 'c85f9e01-37d9-4961-aa03-48e40901d07c', '972c1149-3d4e-4d95-b9f6-49c3b9031539', '42d3fdb1-f936-4b51-80e8-a4801d1ee226'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Delete snapshot completed successfully. Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7211f948-2f77-4552-9611-a20461a2461c tempest-ProjectMemberTests-219285624 None] Lock "cinder-985da92c-2ebb-4e01-9273-5132705022a0-delete_snapshot" released by "delete_snapshot" :: held 3.397s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-519614fc-d935-411d-8a6f-8e45d0f9e9ab-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "cinder-519614fc-d935-411d-8a6f-8e45d0f9e9ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Acquiring lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a94956-fca6-45ce-bd59-a51d0ccd3dcd]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:35 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:36 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab Jul 09 03:09:36 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:36 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab" returned: 0 in 0.824s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:36 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab Jul 09 03:09:36 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:37 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-519614fc-d935-411d-8a6f-8e45d0f9e9ab" returned: 0 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "cinder-quobyte-519614fc-d935-411d-8a6f-8e45d0f9e9ab" released by "delete_volume" :: held 1.584s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Created reservations ['041490b5-5b1c-44c6-b5ed-249908401882', 'ae15f265-054d-4aa6-8089-21bfad5fbaba', '08348009-45a2-489b-a6fa-aaca30ae937d', '40f16684-32d9-4c31-a267-ef61c14091fe'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:37 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:09:37 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:38 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.725s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:38 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Deleted volume successfully. Jul 09 03:09:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-7eb708e4-dd18-46a1-8349-ce5f7cc7d0e9 tempest-ProjectMemberTests-219285624 None] Lock "cinder-519614fc-d935-411d-8a6f-8e45d0f9e9ab-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (711fb1d8-155b-49ae-9ec8-b4c666261d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ee9665-43fd-4f0a-a3f3-5dd0645bc53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ee9665-43fd-4f0a-a3f3-5dd0645bc53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907511972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27f114f-1569-409b-8569-ee61d5630db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:42Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477239b8-53ca-4f74-a5ce-4ba572e847e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477239b8-53ca-4f74-a5ce-4ba572e847e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f01b15f-07a2-43dc-8462-99ebd3c20095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f01b15f-07a2-43dc-8462-99ebd3c20095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27f114f-1569-409b-8569-ee61d5630db7', 'volume_name': 'volume-d27f114f-1569-409b-8569-ee61d5630db7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6cc059-d481-4676-8611-4bb7258f9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6cc059-d481-4676-8611-4bb7258f9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d7def-ee71-404f-a391-bed626b08308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:41 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Volume d27f114f-1569-409b-8569-ee61d5630db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27f114f-1569-409b-8569-ee61d5630db7', 'volume_size': 1} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907511972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27f114f-1569-409b-8569-ee61d5630db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:42Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Creating volume d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:41 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:09:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:42 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 1073741824 Jul 09 03:09:42 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:42 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 1073741824" returned: 0 in 0.829s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:42 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 Jul 09 03:09:42 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:43 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7" returned: 0 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d7def-ee71-404f-a391-bed626b08308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27f114f-1569-409b-8569-ee61d5630db7', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8c21ff-03b4-4e61-b0bc-0de6d2af2ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:43 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Volume volume-d27f114f-1569-409b-8569-ee61d5630db7 (d27f114f-1569-409b-8569-ee61d5630db7): created successfully Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8c21ff-03b4-4e61-b0bc-0de6d2af2ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:43 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (711fb1d8-155b-49ae-9ec8-b4c666261d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:43 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8c5d4f53-7c59-42e0-9411-9b6f66ad9ff6 tempest-ProjectReaderTests-10396731 None] Created volume successfully. Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Creating offline snapshot 08d658ad-da55-43d2-bc10-5fce7e71b032 of volume d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fbf9d2-b843-481d-bf24-0c1c9cfe3d21]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:44 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 Jul 09 03:09:44 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:44 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7" returned: 0 in 0.778s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:45 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 1G Jul 09 03:09:45 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:45 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 1G" returned: 0 in 0.790s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27f114f-1569-409b-8569-ee61d5630db7 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:45 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27f114f-1569-409b-8569-ee61d5630db7 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 Jul 09 03:09:45 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:46 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27f114f-1569-409b-8569-ee61d5630db7 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032" returned: 0 in 0.711s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:46 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 is being set with open permissions: ugo+rw Jul 09 03:09:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:46 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 Jul 09 03:09:46 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:47 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032" returned: 0 in 0.723s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=57,cinder:INSERT=20,cinder:DELETE=7,cinder:UPDATE=74 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:47 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info Jul 09 03:09:47 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:47 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info" returned: 0 in 0.694s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:47 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info is being set with open permissions: ugo+rw Jul 09 03:09:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:47 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info Jul 09 03:09:47 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:48 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.info" returned: 0 in 0.658s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:48 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-7d3f65da-05b6-4278-a4cc-c1ece71def5f tempest-ProjectReaderTests-10396731 None] Create snapshot completed successfully Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-08d658ad-da55-43d2-bc10-5fce7e71b032-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-08d658ad-da55-43d2-bc10-5fce7e71b032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-08d658ad-da55-43d2-bc10-5fce7e71b032" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-08d658ad-da55-43d2-bc10-5fce7e71b032" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Deleting offline snapshot 08d658ad-da55-43d2-bc10-5fce7e71b032 of volume d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] snapshot_file for this snap is: volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3e472-6342-4188-9763-8a15b7480a34]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:49 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 Jul 09 03:09:49 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:50 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032" returned: 0 in 0.841s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:50 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d27f114f-1569-409b-8569-ee61d5630db7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:09:50 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6a4241-2d4f-43c8-bc43-d19d329c7f68]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:50 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 Jul 09 03:09:50 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:51 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7" returned: 0 in 0.824s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:51 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 Jul 09 03:09:51 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:52 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032" returned: 0 in 0.783s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:52 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032 Jul 09 03:09:52 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:52 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7.08d658ad-da55-43d2-bc10-5fce7e71b032" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-08d658ad-da55-43d2-bc10-5fce7e71b032" released by "_delete_snapshot" :: held 3.265s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" released by "delete_snapshot" :: held 3.292s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Created reservations ['3c742e96-08b5-4691-8ecb-d93900a0ab62', '8540e056-6e7c-4416-a105-3c53b1d4cc54', 'e36fd6ba-2ce6-4d57-8a86-f7dd094cb42e', 'cf49f2d8-78e0-4462-b818-cb9df13ca1bd'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:52 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Delete snapshot completed successfully. Jul 09 03:09:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-e2ea35f4-61c4-4313-9267-2299451cdd02 tempest-ProjectReaderTests-10396731 None] Lock "cinder-08d658ad-da55-43d2-bc10-5fce7e71b032-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-d27f114f-1569-409b-8569-ee61d5630db7-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "cinder-d27f114f-1569-409b-8569-ee61d5630db7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[374cd761-f6f1-4ba3-9f61-6fe4eacbaa9d]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:53 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 Jul 09 03:09:53 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:54 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7" returned: 0 in 0.832s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:54 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:54 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7 Jul 09 03:09:54 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:55 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-d27f114f-1569-409b-8569-ee61d5630db7" returned: 0 in 0.680s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d27f114f-1569-409b-8569-ee61d5630db7" released by "delete_volume" :: held 1.574s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Created reservations ['60d1799b-4ac5-4bd1-a33c-88760c385a30', '9d23a6ee-6f29-4ab8-9abb-78c1efbd0cba', 'b0ebbb58-cb54-4fd7-8f05-8e9933cf697b', '84ecbff5-236a-40b7-a2f8-f2eb6a65733c'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:55 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:55 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:09:55 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:56 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.649s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:09:56 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Deleted volume successfully. Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-28a1ac05-49d3-4c70-818c-5468f426bcc7 tempest-ProjectReaderTests-10396731 None] Lock "cinder-d27f114f-1569-409b-8569-ee61d5630db7-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (41d0805d-4c30-4759-8687-6624f8f2d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59c76df-7ae5-4afd-a5ca-0a3088c2cf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59c76df-7ae5-4afd-a5ca-0a3088c2cf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742069881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a2d24-330a-4de9-9766-8251f9ffb735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:56Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1703f63e-1def-4d31-b73f-ee9a99f6c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1703f63e-1def-4d31-b73f-ee9a99f6c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a3365-0e1b-479d-b052-97a6de810251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a3365-0e1b-479d-b052-97a6de810251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786a2d24-330a-4de9-9766-8251f9ffb735', 'volume_name': 'volume-786a2d24-330a-4de9-9766-8251f9ffb735', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f182a9bd-52f0-4f55-83af-9dfbe3280b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f182a9bd-52f0-4f55-83af-9dfbe3280b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a528e3-9d5a-41a2-8960-159ac8562550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:56 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Volume 786a2d24-330a-4de9-9766-8251f9ffb735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786a2d24-330a-4de9-9766-8251f9ffb735', 'volume_size': 1} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742069881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a2d24-330a-4de9-9766-8251f9ffb735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:09:56Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Creating volume 786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:09:56 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:09:56 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:56 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 1073741824 Jul 09 03:09:56 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:57 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 1073741824" returned: 0 in 0.903s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:57 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:57 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 Jul 09 03:09:57 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:58 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735" returned: 0 in 0.664s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a528e3-9d5a-41a2-8960-159ac8562550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786a2d24-330a-4de9-9766-8251f9ffb735', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5abf685-0863-4d7e-8bb7-dc3692da0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:09:58 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Volume volume-786a2d24-330a-4de9-9766-8251f9ffb735 (786a2d24-330a-4de9-9766-8251f9ffb735): created successfully Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5abf685-0863-4d7e-8bb7-dc3692da0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (41d0805d-4c30-4759-8687-6624f8f2d55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:09:58 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-d67f9694-cbe2-4f7a-b2ec-5922ae199ca3 tempest-ProjectReaderTests-10396731 None] Created volume successfully. Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Creating offline snapshot 4b3bcda1-e41f-405f-a1b1-94ed1dd48946 of volume 786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f0b0d-8673-4ad1-b760-5e50d4517d31]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:09:58 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:58 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 Jul 09 03:09:58 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:09:59 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 09 03:09:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735" returned: 0 in 0.763s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:09:59 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:09:59 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 1G Jul 09 03:09:59 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:00 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 1G" returned: 0 in 0.899s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:00 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a2d24-330a-4de9-9766-8251f9ffb735 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:00 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a2d24-330a-4de9-9766-8251f9ffb735 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 Jul 09 03:10:00 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:01 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a2d24-330a-4de9-9766-8251f9ffb735 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946" returned: 0 in 0.765s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:01 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 is being set with open permissions: ugo+rw Jul 09 03:10:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:01 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 Jul 09 03:10:01 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:01 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946" returned: 0 in 0.731s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:01 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:01 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info Jul 09 03:10:01 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:02 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info" returned: 0 in 0.670s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:02 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info is being set with open permissions: ugo+rw Jul 09 03:10:02 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:02 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info Jul 09 03:10:02 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:03 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.info" returned: 0 in 0.639s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.550s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:03 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8609219e-3224-4ead-a8a9-1d9dcf58cbd4 tempest-ProjectReaderTests-10396731 None] Create snapshot completed successfully Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-4b3bcda1-e41f-405f-a1b1-94ed1dd48946-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-4b3bcda1-e41f-405f-a1b1-94ed1dd48946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-4b3bcda1-e41f-405f-a1b1-94ed1dd48946" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-4b3bcda1-e41f-405f-a1b1-94ed1dd48946" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Deleting offline snapshot 4b3bcda1-e41f-405f-a1b1-94ed1dd48946 of volume 786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:10:03 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] snapshot_file for this snap is: volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd12b1-e8fd-405b-beba-9b999702f2c9]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:04 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 Jul 09 03:10:04 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:04 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946" returned: 0 in 0.803s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786a2d24-330a-4de9-9766-8251f9ffb735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4f41fa-a228-42f8-943c-26d1fd213b17]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:04 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:04 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 Jul 09 03:10:04 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:05 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735" returned: 0 in 0.790s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:05 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:05 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 Jul 09 03:10:05 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:06 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946" returned: 0 in 0.757s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:06 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:06 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946 Jul 09 03:10:06 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:07 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:07 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735.4b3bcda1-e41f-405f-a1b1-94ed1dd48946" returned: 0 in 0.664s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-4b3bcda1-e41f-405f-a1b1-94ed1dd48946" released by "_delete_snapshot" :: held 3.109s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" released by "delete_snapshot" :: held 3.134s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:07 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Created reservations ['5ec793dd-c52c-4bc3-be4a-32a24811b9cf', 'a4c5b29c-dcdf-47dd-99bb-0c72d760feb1', 'd48abbf2-1ed4-48ee-bf7a-c2105c7bc786', '330a0f51-850c-4a44-bf5a-2a28580193b4'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:07 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Delete snapshot completed successfully. Jul 09 03:10:07 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1bc10059-4b89-4f21-a8cd-c1ed658092ca tempest-ProjectReaderTests-10396731 None] Lock "cinder-4b3bcda1-e41f-405f-a1b1-94ed1dd48946-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-786a2d24-330a-4de9-9766-8251f9ffb735-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "cinder-786a2d24-330a-4de9-9766-8251f9ffb735-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" acquired by "delete_volume" :: waited 0.015s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc144a7e-2e5e-4688-985d-eb070f005791]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:08 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:08 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 Jul 09 03:10:08 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:09 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735" returned: 0 in 0.822s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:09 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735 Jul 09 03:10:09 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:09 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-786a2d24-330a-4de9-9766-8251f9ffb735" returned: 0 in 0.721s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-786a2d24-330a-4de9-9766-8251f9ffb735" released by "delete_volume" :: held 1.602s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Created reservations ['757738e3-29e5-49b3-bb87-d1ae3778b39e', '8fd91188-f43b-4982-9668-39932daf4182', '819ff450-d79c-48bf-be81-672421cd3ec7', '3a3d2eda-d4f1-4c03-9ec4-588103fdc2e9'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:09 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:09 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:10:09 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:10 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.722s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:10 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Deleted volume successfully. Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-653b90e7-442b-42c9-b720-ca5ff4e9912a tempest-ProjectReaderTests-10396731 None] Lock "cinder-786a2d24-330a-4de9-9766-8251f9ffb735-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (f5210177-6754-41d5-b864-c754130fefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2c2e06-602f-4267-86c2-a70b76094f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2c2e06-602f-4267-86c2-a70b76094f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302056923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1911c25-427c-4907-bd92-f166c3fba737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:11Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c126b-f200-4388-a842-0bebee5eee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c126b-f200-4388-a842-0bebee5eee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4d27a-7ba9-4d1f-8ab3-5f07ae859384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:10 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4d27a-7ba9-4d1f-8ab3-5f07ae859384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1911c25-427c-4907-bd92-f166c3fba737', 'volume_name': 'volume-b1911c25-427c-4907-bd92-f166c3fba737', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5951e77-d6fb-4203-8d3d-986b6f4cb9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5951e77-d6fb-4203-8d3d-986b6f4cb9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7d1281-8d8b-46f5-978d-99b596b7c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:11 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Volume b1911c25-427c-4907-bd92-f166c3fba737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1911c25-427c-4907-bd92-f166c3fba737', 'volume_size': 1} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302056923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1911c25-427c-4907-bd92-f166c3fba737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:11Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Creating volume b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:11 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:11 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 1073741824 Jul 09 03:10:11 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:11 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 1073741824" returned: 0 in 0.930s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:11 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:12 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 Jul 09 03:10:12 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:12 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7d1281-8d8b-46f5-978d-99b596b7c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1911c25-427c-4907-bd92-f166c3fba737', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a3b123-8d64-411b-b3f5-4822dd23a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:12 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Volume volume-b1911c25-427c-4907-bd92-f166c3fba737 (b1911c25-427c-4907-bd92-f166c3fba737): created successfully Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a3b123-8d64-411b-b3f5-4822dd23a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:12 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (f5210177-6754-41d5-b864-c754130fefac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:12 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-9d20f777-59da-4029-bd99-cfd2e55b5691 tempest-ProjectReaderTests-10396731 None] Created volume successfully. Jul 09 03:10:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:13 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Creating offline snapshot 54f375ba-7f33-4d68-bb80-c056eaff419d of volume b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:10:13 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[323dd598-0aa0-4456-9ac2-80318d7d306a]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:13 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:13 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 Jul 09 03:10:13 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:14 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737" returned: 0 in 0.832s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:14 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d 1G Jul 09 03:10:14 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:14 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d 1G" returned: 0 in 0.883s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:14 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1911c25-427c-4907-bd92-f166c3fba737 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:14 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1911c25-427c-4907-bd92-f166c3fba737 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d Jul 09 03:10:14 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:15 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1911c25-427c-4907-bd92-f166c3fba737 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d" returned: 0 in 0.770s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:15 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d is being set with open permissions: ugo+rw Jul 09 03:10:15 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:15 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d Jul 09 03:10:15 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:16 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d" returned: 0 in 0.719s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:16 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:16 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info Jul 09 03:10:16 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:17 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info" returned: 0 in 0.673s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:17 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info is being set with open permissions: ugo+rw Jul 09 03:10:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:17 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info Jul 09 03:10:17 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:17 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.info" returned: 0 in 0.632s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:17 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:17 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-85b3250e-af48-4e5e-817a-5fe206c9579d tempest-ProjectReaderTests-10396731 None] Create snapshot completed successfully Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-54f375ba-7f33-4d68-bb80-c056eaff419d-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-54f375ba-7f33-4d68-bb80-c056eaff419d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-54f375ba-7f33-4d68-bb80-c056eaff419d" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-54f375ba-7f33-4d68-bb80-c056eaff419d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Deleting offline snapshot 54f375ba-7f33-4d68-bb80-c056eaff419d of volume b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] snapshot_file for this snap is: volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d225ef1-f9e6-4964-b6a8-de50978f3a87]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:18 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:18 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d Jul 09 03:10:18 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:19 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d" returned: 0 in 0.743s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:19 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1911c25-427c-4907-bd92-f166c3fba737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:10:19 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ca3d5-5100-445b-99b0-10ec15d944f2]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:19 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:19 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 Jul 09 03:10:19 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:20 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:20 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d Jul 09 03:10:20 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:20 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d" returned: 0 in 0.731s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:20 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:20 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d Jul 09 03:10:20 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:21 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737.54f375ba-7f33-4d68-bb80-c056eaff419d" returned: 0 in 0.623s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-54f375ba-7f33-4d68-bb80-c056eaff419d" released by "_delete_snapshot" :: held 2.934s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" released by "delete_snapshot" :: held 2.957s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Created reservations ['fb1b527e-8fcd-48c6-8964-6c1aecf54094', '0122b9d8-7ec6-4dc0-b1f9-7cf49a814f4b', 'ad8eca57-19e8-4fdc-8443-028349ae6325', '22232c22-8bc6-4b46-ac5e-5c39687bf542'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:21 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Delete snapshot completed successfully. Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-8ff68029-1784-4095-8a73-073929cb22e6 tempest-ProjectReaderTests-10396731 None] Lock "cinder-54f375ba-7f33-4d68-bb80-c056eaff419d-delete_snapshot" released by "delete_snapshot" :: held 3.104s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-b1911c25-427c-4907-bd92-f166c3fba737-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "cinder-b1911c25-427c-4907-bd92-f166c3fba737-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" acquired by "delete_volume" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e0933-6cc0-44ab-bc1e-27dac2b74fdb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:21 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:21 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 Jul 09 03:10:21 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:22 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737" returned: 0 in 0.738s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:22 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:22 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737 Jul 09 03:10:22 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:23 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-b1911c25-427c-4907-bd92-f166c3fba737" returned: 0 in 0.658s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-b1911c25-427c-4907-bd92-f166c3fba737" released by "delete_volume" :: held 1.460s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Created reservations ['c4a0eaa7-0ab7-4396-9980-40a191de4ee6', 'c2c51710-f61e-4bef-bfe1-d16461228a8e', '6eacd1f5-3785-4bdc-861d-e075b4268c37', '061f97e7-7304-4184-ab96-2421e6d37a96'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:23 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:10:23 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:23 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.660s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:23 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Deleted volume successfully. Jul 09 03:10:23 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-1a5ff519-fc6c-438b-b3f0-17947a611cb0 tempest-ProjectReaderTests-10396731 None] Lock "cinder-b1911c25-427c-4907-bd92-f166c3fba737-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (e3394b3a-5f1e-4b59-bb9c-d16ec69b0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d1fb2-845a-454f-b702-19dae41726a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779d1fb2-845a-454f-b702-19dae41726a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987050080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07edac25-cdaa-4555-9906-0357c1ffec98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:24Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2590a61a-419c-4600-9b11-f01dd1c9084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2590a61a-419c-4600-9b11-f01dd1c9084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e4ea99-3d3a-4059-b7a2-39126ce1eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e4ea99-3d3a-4059-b7a2-39126ce1eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07edac25-cdaa-4555-9906-0357c1ffec98', 'volume_name': 'volume-07edac25-cdaa-4555-9906-0357c1ffec98', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f70830-37b7-43c0-8dbe-25f8bd67e250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f70830-37b7-43c0-8dbe-25f8bd67e250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a71433f-acc8-41f8-b29f-61376dfebc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:24 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Volume 07edac25-cdaa-4555-9906-0357c1ffec98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07edac25-cdaa-4555-9906-0357c1ffec98', 'volume_size': 1} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987050080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07edac25-cdaa-4555-9906-0357c1ffec98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:24Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Creating volume 07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:24 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:10:24 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:24 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 1073741824 Jul 09 03:10:24 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:25 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 1073741824" returned: 0 in 0.885s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:25 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:25 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 Jul 09 03:10:25 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:26 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98" returned: 0 in 0.701s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a71433f-acc8-41f8-b29f-61376dfebc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07edac25-cdaa-4555-9906-0357c1ffec98', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8f81c2-a129-45bb-bff5-f2f849d14c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:26 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Volume volume-07edac25-cdaa-4555-9906-0357c1ffec98 (07edac25-cdaa-4555-9906-0357c1ffec98): created successfully Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8f81c2-a129-45bb-bff5-f2f849d14c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (e3394b3a-5f1e-4b59-bb9c-d16ec69b0b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:26 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-2f6cde22-bb45-476a-9709-dea4819d3a97 tempest-ProjectReaderTests-10396731 None] Created volume successfully. Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Creating offline snapshot dfe6d385-9275-4c91-919e-605090991784 of volume 07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2778a-d4e4-45ef-9c4e-5135e9fe72fc]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:26 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:26 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 Jul 09 03:10:26 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:27 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98" returned: 0 in 0.801s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:27 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 1G Jul 09 03:10:27 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:27 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:27 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:10:28 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:28 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 1G" returned: 0 in 0.827s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07edac25-cdaa-4555-9906-0357c1ffec98 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:28 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07edac25-cdaa-4555-9906-0357c1ffec98 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 Jul 09 03:10:28 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:28 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.668s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_service.periodic_task [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] Running periodic task VolumeManager._thread_info {{(pid=87156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread count: 28 {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-38ad89dc-2992-4e6b-b517-f34987b1b865 None None] thread info: [<_MainThread(MainThread, started 123611417895040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 03:10:28 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07edac25-cdaa-4555-9906-0357c1ffec98 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784" returned: 0 in 0.706s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:28 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 is being set with open permissions: ugo+rw Jul 09 03:10:28 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:28 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 Jul 09 03:10:28 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:29 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784" returned: 0 in 0.629s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:29 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:29 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info Jul 09 03:10:29 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:30 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info" returned: 0 in 0.668s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:30 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info is being set with open permissions: ugo+rw Jul 09 03:10:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:30 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info Jul 09 03:10:30 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:30 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.info" returned: 0 in 0.636s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:30 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:30 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-98bcf2d4-1181-438c-a406-0d58d3061e13 tempest-ProjectReaderTests-10396731 None] Create snapshot completed successfully Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-dfe6d385-9275-4c91-919e-605090991784-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-dfe6d385-9275-4c91-919e-605090991784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-dfe6d385-9275-4c91-919e-605090991784" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-dfe6d385-9275-4c91-919e-605090991784" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Deleting offline snapshot dfe6d385-9275-4c91-919e-605090991784 of volume 07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] snapshot_file for this snap is: volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a85d7b-7f09-4a58-8ad1-d0650ce0fcb7]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:31 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:32 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 Jul 09 03:10:32 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:32 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784" returned: 0 in 0.811s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:32 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07edac25-cdaa-4555-9906-0357c1ffec98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:10:32 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[107b55c3-94dc-4091-a8af-b19ff438c8df]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:32 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:32 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 Jul 09 03:10:32 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:33 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98" returned: 0 in 0.818s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:33 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:33 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 Jul 09 03:10:33 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:34 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784" returned: 0 in 0.716s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:34 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784 Jul 09 03:10:34 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:34 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:34 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98.dfe6d385-9275-4c91-919e-605090991784" returned: 0 in 0.654s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-dfe6d385-9275-4c91-919e-605090991784" released by "_delete_snapshot" :: held 3.106s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:34 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" released by "delete_snapshot" :: held 3.130s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:35 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Created reservations ['1efd00b7-491d-425b-ae70-8524de50f94a', 'cfae757a-69ba-427f-8ef1-89518c72c3b1', '5d033028-ec95-41e9-a076-677fcde9c987', 'b702dae1-bba5-4166-abfb-fb91747e6dee'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:35 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Delete snapshot completed successfully. Jul 09 03:10:35 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-ac1e2cb3-75fd-4e4e-ad94-a0e9f3a9cc79 tempest-ProjectReaderTests-10396731 None] Lock "cinder-dfe6d385-9275-4c91-919e-605090991784-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-07edac25-cdaa-4555-9906-0357c1ffec98-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "cinder-07edac25-cdaa-4555-9906-0357c1ffec98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" acquired by "delete_volume" :: waited 0.013s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab791e-c3fb-4ca6-b144-d1c26fbf08bb]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:36 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 Jul 09 03:10:36 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:36 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98" returned: 0 in 0.767s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:36 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:36 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98 Jul 09 03:10:36 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:37 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-07edac25-cdaa-4555-9906-0357c1ffec98" returned: 0 in 0.639s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-07edac25-cdaa-4555-9906-0357c1ffec98" released by "delete_volume" :: held 1.466s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Created reservations ['f5ce7b65-440d-4461-9b43-65476d7944a9', '7d68985e-2f97-4c3b-8d56-5a01e9ba4b5c', '3e3128a1-4265-4fc5-8d0b-15e2b3c1fb03', '96a6a494-d519-4825-9ef9-6c0019a40587'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:37 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:37 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:10:37 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:38 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.796s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:38 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Deleted volume successfully. Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-61cb36bf-7da0-4b22-a1b6-f3cc97895e83 tempest-ProjectReaderTests-10396731 None] Lock "cinder-07edac25-cdaa-4555-9906-0357c1ffec98-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87156) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (1a79f0dd-61d6-4309-b80e-4d3856b74a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb076435-0c28-4e9a-a4d9-b7484f4d1583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb076435-0c28-4e9a-a4d9-b7484f4d1583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537250348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68934e9-2d86-4f38-8e38-26f7b1fd33d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:39Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a403f4-0aa9-4691-b625-aedb8b7ee27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a403f4-0aa9-4691-b625-aedb8b7ee27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7de9323-98f6-4628-b52a-93c219862393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7de9323-98f6-4628-b52a-93c219862393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68934e9-2d86-4f38-8e38-26f7b1fd33d3', 'volume_name': 'volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86996be-5f22-428a-9044-f72478584d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86996be-5f22-428a-9044-f72478584d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e432df9-0694-4ec8-984d-b5e404d7fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:38 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Volume a68934e9-2d86-4f38-8e38-26f7b1fd33d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3', 'volume_size': 1} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T01:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537250348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68934e9-2d86-4f38-8e38-26f7b1fd33d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08dfdf5fc024742827abff8f76fc468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T01:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T01:10:39Z,use_quota=True,user_id='8d09e33ce63c425eb78e6cffc08a34b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ece620-f4d9-4209-91cf-be90a0a690d8),volume_type_id=94ece620-f4d9-4209-91cf-be90a0a690d8)}" {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Creating volume a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 as target Quobyte volume. {{(pid=87156) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 03:10:38 devstack cinder-volume[87156]: INFO cinder.volume.drivers.remotefs [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9 Jul 09 03:10:38 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 1073741824 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:38 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 1073741824 Jul 09 03:10:38 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:39 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 1073741824" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:39 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:39 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 Jul 09 03:10:39 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:40 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" returned: 0 in 0.684s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'} {{(pid=87156) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e432df9-0694-4ec8-984d-b5e404d7fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3', 'volume_size': 1}' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a9812-8d7a-4848-8ae8-41c3f9d9d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 03:10:40 devstack cinder-volume[87156]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Volume volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 (a68934e9-2d86-4f38-8e38-26f7b1fd33d3): created successfully Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a9812-8d7a-4848-8ae8-41c3f9d9d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87156) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 03:10:40 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Flow 'volume_create_manager' (1a79f0dd-61d6-4309-b80e-4d3856b74a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87156) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 03:10:40 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-4d4ee1dc-b894-4d2c-a66d-a2262539c1e5 tempest-ProjectReaderTests-10396731 None] Created volume successfully. Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Creating offline snapshot d1784235-429f-4291-8cf2-7d04250f425e of volume a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda32305-b899-4b53-91d8-fe2b5c7698b8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:41 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 Jul 09 03:10:41 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:41 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" returned: 0 in 0.760s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e 1G {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:41 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e 1G Jul 09 03:10:41 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:42 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e 1G" returned: 0 in 0.834s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:42 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:42 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e Jul 09 03:10:42 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:43 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 -F qcow2 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e" returned: 0 in 0.692s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:43 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e is being set with open permissions: ugo+rw Jul 09 03:10:43 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:43 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e Jul 09 03:10:43 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:44 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e" returned: 0 in 0.635s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:44 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info Jul 09 03:10:44 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:44 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info" returned: 0 in 0.703s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:44 devstack cinder-volume[87156]: WARNING cinder.volume.drivers.remotefs [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info is being set with open permissions: ugo+rw Jul 09 03:10:44 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:44 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info Jul 09 03:10:44 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:45 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.info" returned: 0 in 0.748s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:45 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:45 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-bcb78bcb-9e93-4528-b148-c1e164ece059 tempest-ProjectReaderTests-10396731 None] Create snapshot completed successfully Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-d1784235-429f-4291-8cf2-7d04250f425e-delete_snapshot" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-d1784235-429f-4291-8cf2-7d04250f425e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" by "delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-d1784235-429f-4291-8cf2-7d04250f425e" by "_delete_snapshot" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d1784235-429f-4291-8cf2-7d04250f425e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Deleting offline snapshot d1784235-429f-4291-8cf2-7d04250f425e of volume a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] snapshot_file for this snap is: volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42b8ac-f72b-4f94-930f-e44dc1d9b0c8]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:46 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:46 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e Jul 09 03:10:46 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:47 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e" returned: 0 in 0.838s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:47 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.remotefs [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87156) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 03:10:47 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dcdd98-e3ee-4e06-81ce-e9a1e50069f3]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:47 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:47 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 Jul 09 03:10:47 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:48 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" returned: 0 in 0.904s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:48 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e Jul 09 03:10:48 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:48 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e" returned: 0 in 0.746s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:48 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:48 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e Jul 09 03:10:48 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:49 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3.d1784235-429f-4291-8cf2-7d04250f425e" returned: 0 in 0.684s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-d1784235-429f-4291-8cf2-7d04250f425e" released by "_delete_snapshot" :: held 3.275s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" released by "delete_snapshot" :: held 3.308s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:UPDATE=72,cinder:SELECT=52,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:DELETE=5,cinder:UPDATE=73 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Created reservations ['a1f8b022-f5c6-40aa-a4f1-dbbbab1018df', '7e8e8213-2b62-43b9-9958-64a2ae04adaa', '65fb41ae-2a62-4803-9696-c0ab5881e026', '84f51518-6301-4855-b014-f9005e1b5333'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:49 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Delete snapshot completed successfully. Jul 09 03:10:49 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-501c7647-0bf6-4ff6-a924-82753f4c9f35 tempest-ProjectReaderTests-10396731 None] Lock "cinder-d1784235-429f-4291-8cf2-7d04250f425e-delete_snapshot" released by "delete_snapshot" :: held 3.481s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-a68934e9-2d86-4f38-8e38-26f7b1fd33d3-delete_volume" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "cinder-a68934e9-2d86-4f38-8e38-26f7b1fd33d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Acquiring lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" by "delete_volume" {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87156) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec88a7d-bc2e-4c73-b007-2bd0c560c131]: (4, 'qcow2') {{(pid=88483) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 03:10:50 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:50 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 Jul 09 03:10:50 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:51 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" returned: 0 in 0.872s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:51 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:51 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3 Jul 09 03:10:51 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:52 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b/volume-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" returned: 0 in 0.733s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "cinder-quobyte-a68934e9-2d86-4f38-8e38-26f7b1fd33d3" released by "delete_volume" :: held 1.664s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG cinder.quota [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Created reservations ['f896c6bd-e32a-46c1-b9dd-85ec3bce4672', '78c604e8-76a0-43ed-bfd2-8a6193cac4e1', 'c63101cd-05f6-4639-a7fd-348c4ab326d0', '57a933ee-ac50-4c8b-b580-08afbc030b60'] {{(pid=87156) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9': None} {{(pid=87156) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG cinder.volume.drivers.quobyte [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfff8e4f-dc18-4b20-8c20-5f3e8acb2ff9'] {{(pid=87156) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87156) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 03:10:52 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 03:10:52 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b Jul 09 03:10:52 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 03:10:53 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 09 03:10:53 devstack cinder-volume[87156]: DEBUG oslo_concurrency.processutils [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79824450dd292ebf72842a493e79fd7b" returned: 0 in 0.747s {{(pid=87156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 03:10:53 devstack cinder-volume[87156]: DEBUG cinder.manager [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Notifying Schedulers of capabilities ... {{(pid=87156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 03:10:53 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Deleted volume successfully. Jul 09 03:10:53 devstack cinder-volume[87156]: DEBUG cinder.coordination [None req-450c81f4-af0c-444c-8cb4-853ce666d161 tempest-ProjectReaderTests-10396731 None] Lock "cinder-a68934e9-2d86-4f38-8e38-26f7b1fd33d3-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87156) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 03:11:02 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 03:11:03 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}